2023-08-03 08:56:55,669 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6 2023-08-03 08:56:55,682 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling timeout: 13 mins 2023-08-03 08:56:55,713 INFO [Time-limited test] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=238, ProcessCount=176, AvailableMemoryMB=1821 2023-08-03 08:56:55,719 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-03 08:56:55,720 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680, deleteOnExit=true 2023-08-03 08:56:55,720 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-03 08:56:55,720 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/test.cache.data in system properties and HBase conf 2023-08-03 08:56:55,721 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/hadoop.tmp.dir in system properties and HBase conf 2023-08-03 08:56:55,721 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/hadoop.log.dir in system properties and HBase conf 2023-08-03 08:56:55,721 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-03 08:56:55,722 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-03 08:56:55,722 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-03 08:56:55,828 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-08-03 08:56:56,193 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-03 08:56:56,197 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-03 08:56:56,197 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-03 08:56:56,198 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-03 08:56:56,198 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-03 08:56:56,198 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-03 08:56:56,199 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-03 08:56:56,199 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-03 08:56:56,199 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-03 08:56:56,200 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-03 08:56:56,200 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/nfs.dump.dir in system properties and HBase conf 2023-08-03 08:56:56,201 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/java.io.tmpdir in system properties and HBase conf 2023-08-03 08:56:56,201 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-03 08:56:56,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-03 08:56:56,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-03 08:56:56,703 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-03 08:56:56,707 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-03 08:56:56,980 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-08-03 08:56:57,136 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-08-03 08:56:57,150 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:56:57,187 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:56:57,246 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/java.io.tmpdir/Jetty_localhost_39795_hdfs____.xzsm3t/webapp 2023-08-03 08:56:57,379 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39795 2023-08-03 08:56:57,389 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-03 08:56:57,390 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-03 08:56:57,828 WARN [Listener at localhost/36349] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:56:57,894 WARN [Listener at localhost/36349] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-03 08:56:57,911 WARN [Listener at localhost/36349] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:56:57,917 INFO [Listener at localhost/36349] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:56:57,922 INFO [Listener at localhost/36349] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/java.io.tmpdir/Jetty_localhost_42705_datanode____4gd1yd/webapp 2023-08-03 08:56:58,023 INFO [Listener at localhost/36349] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42705 2023-08-03 08:56:58,345 WARN [Listener at localhost/40259] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:56:58,358 WARN [Listener at localhost/40259] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-03 08:56:58,362 WARN [Listener at localhost/40259] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:56:58,364 INFO [Listener at localhost/40259] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:56:58,371 INFO [Listener at localhost/40259] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/java.io.tmpdir/Jetty_localhost_45095_datanode____dh2d1u/webapp 2023-08-03 08:56:58,473 INFO [Listener at localhost/40259] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45095 2023-08-03 08:56:58,481 WARN [Listener at localhost/33551] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:56:58,797 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2d61dbc4067b8108: Processing first storage report for DS-abdf04a7-f6cc-4261-9d5a-fbfbb2413d16 from datanode 8ea1ff26-8523-4324-b563-8966fb9d1bd0 2023-08-03 08:56:58,798 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2d61dbc4067b8108: from storage DS-abdf04a7-f6cc-4261-9d5a-fbfbb2413d16 node DatanodeRegistration(127.0.0.1:40185, datanodeUuid=8ea1ff26-8523-4324-b563-8966fb9d1bd0, infoPort=39597, infoSecurePort=0, ipcPort=33551, storageInfo=lv=-57;cid=testClusterID;nsid=911681346;c=1691053016781), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-03 08:56:58,799 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa2296f45a19fb89d: Processing first storage report for DS-f9035294-4731-45e6-baeb-fc48a96e8fd9 from datanode 1a4cd756-a3d3-4e7f-9608-d4ffbd91f8cd 2023-08-03 08:56:58,799 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa2296f45a19fb89d: from storage DS-f9035294-4731-45e6-baeb-fc48a96e8fd9 node DatanodeRegistration(127.0.0.1:34965, datanodeUuid=1a4cd756-a3d3-4e7f-9608-d4ffbd91f8cd, infoPort=41183, infoSecurePort=0, ipcPort=40259, storageInfo=lv=-57;cid=testClusterID;nsid=911681346;c=1691053016781), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:56:58,799 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2d61dbc4067b8108: Processing first storage report for DS-1e86c27a-37b0-4f93-8fb5-2eb5b07e2c64 from datanode 8ea1ff26-8523-4324-b563-8966fb9d1bd0 2023-08-03 08:56:58,799 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2d61dbc4067b8108: from storage DS-1e86c27a-37b0-4f93-8fb5-2eb5b07e2c64 node DatanodeRegistration(127.0.0.1:40185, datanodeUuid=8ea1ff26-8523-4324-b563-8966fb9d1bd0, infoPort=39597, infoSecurePort=0, ipcPort=33551, storageInfo=lv=-57;cid=testClusterID;nsid=911681346;c=1691053016781), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:56:58,799 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa2296f45a19fb89d: Processing first storage report for DS-5b807e0e-513f-4b4a-9a39-8318276731da from datanode 1a4cd756-a3d3-4e7f-9608-d4ffbd91f8cd 2023-08-03 08:56:58,799 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa2296f45a19fb89d: from storage DS-5b807e0e-513f-4b4a-9a39-8318276731da node DatanodeRegistration(127.0.0.1:34965, datanodeUuid=1a4cd756-a3d3-4e7f-9608-d4ffbd91f8cd, infoPort=41183, infoSecurePort=0, ipcPort=40259, storageInfo=lv=-57;cid=testClusterID;nsid=911681346;c=1691053016781), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:56:58,863 DEBUG [Listener at localhost/33551] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6 2023-08-03 08:56:58,933 INFO [Listener at localhost/33551] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/zookeeper_0, clientPort=63594, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-03 08:56:58,946 INFO [Listener at localhost/33551] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63594 2023-08-03 08:56:58,954 INFO [Listener at localhost/33551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:56:58,956 INFO [Listener at localhost/33551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:56:59,606 INFO [Listener at localhost/33551] util.FSUtils(471): Created version file at hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e with version=8 2023-08-03 08:56:59,607 INFO [Listener at localhost/33551] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/hbase-staging 2023-08-03 08:56:59,908 INFO [Listener at localhost/33551] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-08-03 08:57:00,374 INFO [Listener at localhost/33551] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-03 08:57:00,406 INFO [Listener at localhost/33551] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:57:00,406 INFO [Listener at localhost/33551] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-03 08:57:00,407 INFO [Listener at localhost/33551] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-03 08:57:00,407 INFO [Listener at localhost/33551] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:57:00,407 INFO [Listener at localhost/33551] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-03 08:57:00,548 INFO [Listener at localhost/33551] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-03 08:57:00,619 DEBUG [Listener at localhost/33551] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-08-03 08:57:00,713 INFO [Listener at localhost/33551] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42383 2023-08-03 08:57:00,723 INFO [Listener at localhost/33551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:00,725 INFO [Listener at localhost/33551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:00,747 INFO [Listener at localhost/33551] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42383 connecting to ZooKeeper ensemble=127.0.0.1:63594 2023-08-03 08:57:00,788 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:423830x0, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-03 08:57:00,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42383-0x101ca0bd2290000 connected 2023-08-03 08:57:00,812 DEBUG [Listener at localhost/33551] zookeeper.ZKUtil(164): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-03 08:57:00,813 DEBUG [Listener at localhost/33551] zookeeper.ZKUtil(164): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:57:00,816 DEBUG [Listener at localhost/33551] zookeeper.ZKUtil(164): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-03 08:57:00,824 DEBUG [Listener at localhost/33551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42383 2023-08-03 08:57:00,824 DEBUG [Listener at localhost/33551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42383 2023-08-03 08:57:00,825 DEBUG [Listener at localhost/33551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42383 2023-08-03 08:57:00,825 DEBUG [Listener at localhost/33551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42383 2023-08-03 08:57:00,826 DEBUG [Listener at localhost/33551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42383 2023-08-03 08:57:00,832 INFO [Listener at localhost/33551] master.HMaster(444): hbase.rootdir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e, hbase.cluster.distributed=false 2023-08-03 08:57:00,899 INFO [Listener at localhost/33551] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-03 08:57:00,899 INFO [Listener at localhost/33551] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:57:00,899 INFO [Listener at localhost/33551] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-03 08:57:00,900 INFO [Listener at localhost/33551] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-03 08:57:00,900 INFO [Listener at localhost/33551] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:57:00,900 INFO [Listener at localhost/33551] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-03 08:57:00,905 INFO [Listener at localhost/33551] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-03 08:57:00,907 INFO [Listener at localhost/33551] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34599 2023-08-03 08:57:00,909 INFO [Listener at localhost/33551] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-03 08:57:00,915 DEBUG [Listener at localhost/33551] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-03 08:57:00,917 INFO [Listener at localhost/33551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:00,919 INFO [Listener at localhost/33551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:00,920 INFO [Listener at localhost/33551] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34599 connecting to ZooKeeper ensemble=127.0.0.1:63594 2023-08-03 08:57:00,928 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): regionserver:345990x0, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-03 08:57:00,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34599-0x101ca0bd2290001 connected 2023-08-03 08:57:00,929 DEBUG [Listener at localhost/33551] zookeeper.ZKUtil(164): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-03 08:57:00,930 DEBUG [Listener at localhost/33551] zookeeper.ZKUtil(164): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:57:00,931 DEBUG [Listener at localhost/33551] zookeeper.ZKUtil(164): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-03 08:57:00,932 DEBUG [Listener at localhost/33551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34599 2023-08-03 08:57:00,932 DEBUG [Listener at localhost/33551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34599 2023-08-03 08:57:00,932 DEBUG [Listener at localhost/33551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34599 2023-08-03 08:57:00,933 DEBUG [Listener at localhost/33551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34599 2023-08-03 08:57:00,933 DEBUG [Listener at localhost/33551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34599 2023-08-03 08:57:00,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42383,1691053019751 2023-08-03 08:57:00,943 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-03 08:57:00,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42383,1691053019751 2023-08-03 08:57:00,965 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-03 08:57:00,965 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-03 08:57:00,965 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:00,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-03 08:57:00,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42383,1691053019751 from backup master directory 2023-08-03 08:57:00,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-03 08:57:00,970 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42383,1691053019751 2023-08-03 08:57:00,971 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-03 08:57:00,971 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-03 08:57:00,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42383,1691053019751 2023-08-03 08:57:00,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-08-03 08:57:00,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-08-03 08:57:01,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/hbase.id with ID: 81dc2e1b-a670-48d7-a67f-cf99bf45a252 2023-08-03 08:57:01,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:01,112 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:01,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x48e92653 to 127.0.0.1:63594 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-03 08:57:01,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b280bcc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-03 08:57:01,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-03 08:57:01,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-03 08:57:01,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:57:01,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/data/master/store-tmp 2023-08-03 08:57:01,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:01,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-03 08:57:01,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:57:01,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:57:01,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-03 08:57:01,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:57:01,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:57:01,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-03 08:57:01,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/WALs/jenkins-hbase4.apache.org,42383,1691053019751 2023-08-03 08:57:01,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42383%2C1691053019751, suffix=, logDir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/WALs/jenkins-hbase4.apache.org,42383,1691053019751, archiveDir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/oldWALs, maxLogs=10 2023-08-03 08:57:01,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-08-03 08:57:01,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-08-03 08:57:01,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:53) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:190) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:719) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:128) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:881) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:574) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:515) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:160) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:295) at org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:200) at org.apache.hadoop.hbase.master.region.MasterRegion.bootstrap(MasterRegion.java:220) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:348) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:01,377 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:417) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:01,378 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34965,DS-f9035294-4731-45e6-baeb-fc48a96e8fd9,DISK] 2023-08-03 08:57:01,378 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40185,DS-abdf04a7-f6cc-4261-9d5a-fbfbb2413d16,DISK] 2023-08-03 08:57:01,386 DEBUG [RS-EventLoopGroup-3-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:01,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/WALs/jenkins-hbase4.apache.org,42383,1691053019751/jenkins-hbase4.apache.org%2C42383%2C1691053019751.1691053021320 2023-08-03 08:57:01,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34965,DS-f9035294-4731-45e6-baeb-fc48a96e8fd9,DISK], DatanodeInfoWithStorage[127.0.0.1:40185,DS-abdf04a7-f6cc-4261-9d5a-fbfbb2413d16,DISK]] 2023-08-03 08:57:01,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:57:01,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:01,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:57:01,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:57:01,510 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:57:01,516 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-03 08:57:01,539 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-03 08:57:01,550 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:01,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:57:01,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:57:01,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:57:01,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:57:01,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=826659, jitterRate=0.051152512431144714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:57:01,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-03 08:57:01,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-03 08:57:01,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-03 08:57:01,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-03 08:57:01,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-03 08:57:01,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-08-03 08:57:01,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 31 msec 2023-08-03 08:57:01,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-03 08:57:01,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-03 08:57:01,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-03 08:57:01,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-03 08:57:01,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-03 08:57:01,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-03 08:57:01,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-03 08:57:01,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-03 08:57:01,708 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:01,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-03 08:57:01,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-03 08:57:01,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-03 08:57:01,725 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-03 08:57:01,725 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-03 08:57:01,725 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:01,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42383,1691053019751, sessionid=0x101ca0bd2290000, setting cluster-up flag (Was=false) 2023-08-03 08:57:01,741 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:01,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-03 08:57:01,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42383,1691053019751 2023-08-03 08:57:01,753 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:01,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-03 08:57:01,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42383,1691053019751 2023-08-03 08:57:01,762 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/.hbase-snapshot/.tmp 2023-08-03 08:57:01,837 INFO [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(951): ClusterId : 81dc2e1b-a670-48d7-a67f-cf99bf45a252 2023-08-03 08:57:01,842 DEBUG [RS:0;jenkins-hbase4:34599] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-03 08:57:01,849 DEBUG [RS:0;jenkins-hbase4:34599] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-03 08:57:01,849 DEBUG [RS:0;jenkins-hbase4:34599] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-03 08:57:01,852 DEBUG [RS:0;jenkins-hbase4:34599] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-03 08:57:01,853 DEBUG [RS:0;jenkins-hbase4:34599] zookeeper.ReadOnlyZKClient(139): Connect 0x7b29c64b to 127.0.0.1:63594 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-03 08:57:01,860 DEBUG [RS:0;jenkins-hbase4:34599] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75ee375e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-03 08:57:01,860 DEBUG [RS:0;jenkins-hbase4:34599] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71d1ad3b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-03 08:57:01,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-03 08:57:01,883 DEBUG [RS:0;jenkins-hbase4:34599] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34599 2023-08-03 08:57:01,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:57:01,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:57:01,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:57:01,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:57:01,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-03 08:57:01,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:01,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-03 08:57:01,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:01,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1691053051886 2023-08-03 08:57:01,887 INFO [RS:0;jenkins-hbase4:34599] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-03 08:57:01,887 INFO [RS:0;jenkins-hbase4:34599] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-03 08:57:01,887 DEBUG [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1022): About to register with Master. 2023-08-03 08:57:01,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-03 08:57:01,891 INFO [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42383,1691053019751 with isa=jenkins-hbase4.apache.org/172.31.14.131:34599, startcode=1691053020898 2023-08-03 08:57:01,893 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-03 08:57:01,893 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-03 08:57:01,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-03 08:57:01,899 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-03 08:57:01,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-03 08:57:01,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-03 08:57:01,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-03 08:57:01,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-03 08:57:01,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:01,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-03 08:57:01,910 DEBUG [RS:0;jenkins-hbase4:34599] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-03 08:57:01,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-03 08:57:01,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-03 08:57:01,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-03 08:57:01,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-03 08:57:01,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691053021915,5,FailOnTimeoutGroup] 2023-08-03 08:57:01,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691053021916,5,FailOnTimeoutGroup] 2023-08-03 08:57:01,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:01,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-03 08:57:01,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:01,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:01,938 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-03 08:57:01,939 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-03 08:57:01,940 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e 2023-08-03 08:57:01,959 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:01,962 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-03 08:57:01,965 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/info 2023-08-03 08:57:01,966 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-03 08:57:01,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:01,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-03 08:57:01,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/rep_barrier 2023-08-03 08:57:01,972 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-03 08:57:01,973 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:01,973 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-03 08:57:01,975 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/table 2023-08-03 08:57:01,976 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-03 08:57:01,976 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58133, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-08-03 08:57:01,977 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:01,979 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740 2023-08-03 08:57:01,979 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740 2023-08-03 08:57:01,983 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-03 08:57:01,985 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-03 08:57:01,989 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:57:01,990 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=870620, jitterRate=0.10705065727233887}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-03 08:57:01,990 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-03 08:57:01,990 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42383] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:01,991 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-03 08:57:01,991 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-03 08:57:01,991 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-03 08:57:01,991 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-03 08:57:01,991 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-03 08:57:01,992 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-03 08:57:01,992 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-03 08:57:01,997 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-03 08:57:01,997 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-03 08:57:02,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-03 08:57:02,009 DEBUG [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e 2023-08-03 08:57:02,009 DEBUG [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36349 2023-08-03 08:57:02,010 DEBUG [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-03 08:57:02,016 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-03 08:57:02,017 DEBUG [RS:0;jenkins-hbase4:34599] zookeeper.ZKUtil(162): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:02,017 WARN [RS:0;jenkins-hbase4:34599] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-03 08:57:02,018 INFO [RS:0;jenkins-hbase4:34599] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:57:02,018 DEBUG [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:02,019 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34599,1691053020898] 2023-08-03 08:57:02,022 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-03 08:57:02,025 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-03 08:57:02,028 DEBUG [RS:0;jenkins-hbase4:34599] zookeeper.ZKUtil(162): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:02,037 DEBUG [RS:0;jenkins-hbase4:34599] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-03 08:57:02,045 INFO [RS:0;jenkins-hbase4:34599] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-03 08:57:02,066 INFO [RS:0;jenkins-hbase4:34599] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-03 08:57:02,069 INFO [RS:0;jenkins-hbase4:34599] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-03 08:57:02,069 INFO [RS:0;jenkins-hbase4:34599] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:02,070 INFO [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-03 08:57:02,077 INFO [RS:0;jenkins-hbase4:34599] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:02,078 DEBUG [RS:0;jenkins-hbase4:34599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:02,078 DEBUG [RS:0;jenkins-hbase4:34599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:02,078 DEBUG [RS:0;jenkins-hbase4:34599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:02,079 DEBUG [RS:0;jenkins-hbase4:34599] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:02,079 DEBUG [RS:0;jenkins-hbase4:34599] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:02,079 DEBUG [RS:0;jenkins-hbase4:34599] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-03 08:57:02,079 DEBUG [RS:0;jenkins-hbase4:34599] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:02,079 DEBUG [RS:0;jenkins-hbase4:34599] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:02,079 DEBUG [RS:0;jenkins-hbase4:34599] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:02,080 DEBUG [RS:0;jenkins-hbase4:34599] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:02,081 INFO [RS:0;jenkins-hbase4:34599] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:02,081 INFO [RS:0;jenkins-hbase4:34599] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:02,081 INFO [RS:0;jenkins-hbase4:34599] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:02,100 INFO [RS:0;jenkins-hbase4:34599] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-03 08:57:02,102 INFO [RS:0;jenkins-hbase4:34599] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34599,1691053020898-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:02,118 INFO [RS:0;jenkins-hbase4:34599] regionserver.Replication(203): jenkins-hbase4.apache.org,34599,1691053020898 started 2023-08-03 08:57:02,119 INFO [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34599,1691053020898, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34599, sessionid=0x101ca0bd2290001 2023-08-03 08:57:02,119 DEBUG [RS:0;jenkins-hbase4:34599] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-03 08:57:02,119 DEBUG [RS:0;jenkins-hbase4:34599] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:02,119 DEBUG [RS:0;jenkins-hbase4:34599] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34599,1691053020898' 2023-08-03 08:57:02,119 DEBUG [RS:0;jenkins-hbase4:34599] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:57:02,120 DEBUG [RS:0;jenkins-hbase4:34599] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:57:02,120 DEBUG [RS:0;jenkins-hbase4:34599] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-03 08:57:02,120 DEBUG [RS:0;jenkins-hbase4:34599] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-03 08:57:02,120 DEBUG [RS:0;jenkins-hbase4:34599] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:02,120 DEBUG [RS:0;jenkins-hbase4:34599] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34599,1691053020898' 2023-08-03 08:57:02,120 DEBUG [RS:0;jenkins-hbase4:34599] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-03 08:57:02,121 DEBUG [RS:0;jenkins-hbase4:34599] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-03 08:57:02,121 DEBUG [RS:0;jenkins-hbase4:34599] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-03 08:57:02,121 INFO [RS:0;jenkins-hbase4:34599] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-03 08:57:02,121 INFO [RS:0;jenkins-hbase4:34599] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-03 08:57:02,176 DEBUG [jenkins-hbase4:42383] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-03 08:57:02,179 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34599,1691053020898, state=OPENING 2023-08-03 08:57:02,186 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-03 08:57:02,188 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:02,188 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-03 08:57:02,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34599,1691053020898}] 2023-08-03 08:57:02,232 INFO [RS:0;jenkins-hbase4:34599] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34599%2C1691053020898, suffix=, logDir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898, archiveDir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/oldWALs, maxLogs=32 2023-08-03 08:57:02,251 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40185,DS-abdf04a7-f6cc-4261-9d5a-fbfbb2413d16,DISK] 2023-08-03 08:57:02,252 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34965,DS-f9035294-4731-45e6-baeb-fc48a96e8fd9,DISK] 2023-08-03 08:57:02,256 INFO [RS:0;jenkins-hbase4:34599] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.1691053022235 2023-08-03 08:57:02,256 DEBUG [RS:0;jenkins-hbase4:34599] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40185,DS-abdf04a7-f6cc-4261-9d5a-fbfbb2413d16,DISK], DatanodeInfoWithStorage[127.0.0.1:34965,DS-f9035294-4731-45e6-baeb-fc48a96e8fd9,DISK]] 2023-08-03 08:57:02,375 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:02,379 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-03 08:57:02,382 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-03 08:57:02,394 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-03 08:57:02,394 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:57:02,398 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta, suffix=.meta, logDir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898, archiveDir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/oldWALs, maxLogs=32 2023-08-03 08:57:02,414 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40185,DS-abdf04a7-f6cc-4261-9d5a-fbfbb2413d16,DISK] 2023-08-03 08:57:02,415 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34965,DS-f9035294-4731-45e6-baeb-fc48a96e8fd9,DISK] 2023-08-03 08:57:02,421 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta.1691053022399.meta 2023-08-03 08:57:02,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40185,DS-abdf04a7-f6cc-4261-9d5a-fbfbb2413d16,DISK], DatanodeInfoWithStorage[127.0.0.1:34965,DS-f9035294-4731-45e6-baeb-fc48a96e8fd9,DISK]] 2023-08-03 08:57:02,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:57:02,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-03 08:57:02,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-03 08:57:02,446 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-03 08:57:02,451 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-03 08:57:02,452 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:02,452 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-03 08:57:02,452 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-03 08:57:02,455 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-03 08:57:02,457 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/info 2023-08-03 08:57:02,457 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/info 2023-08-03 08:57:02,457 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-03 08:57:02,458 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:02,459 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-03 08:57:02,460 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/rep_barrier 2023-08-03 08:57:02,460 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/rep_barrier 2023-08-03 08:57:02,460 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-03 08:57:02,461 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:02,461 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-03 08:57:02,463 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/table 2023-08-03 08:57:02,463 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/table 2023-08-03 08:57:02,463 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-03 08:57:02,464 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:02,466 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740 2023-08-03 08:57:02,468 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740 2023-08-03 08:57:02,472 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-03 08:57:02,474 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-03 08:57:02,476 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=756995, jitterRate=-0.03743162751197815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-03 08:57:02,476 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-03 08:57:02,486 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1691053022368 2023-08-03 08:57:02,503 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-03 08:57:02,503 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-03 08:57:02,504 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34599,1691053020898, state=OPEN 2023-08-03 08:57:02,508 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-03 08:57:02,508 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-03 08:57:02,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-03 08:57:02,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34599,1691053020898 in 316 msec 2023-08-03 08:57:02,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-03 08:57:02,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 507 msec 2023-08-03 08:57:02,522 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 716 msec 2023-08-03 08:57:02,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1691053022523, completionTime=-1 2023-08-03 08:57:02,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-03 08:57:02,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-03 08:57:02,584 DEBUG [hconnection-0x391ffa8c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-03 08:57:02,587 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-03 08:57:02,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-03 08:57:02,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1691053082603 2023-08-03 08:57:02,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1691053142603 2023-08-03 08:57:02,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 80 msec 2023-08-03 08:57:02,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42383,1691053019751-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:02,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42383,1691053019751-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:02,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42383,1691053019751-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:02,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42383, period=300000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:02,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:02,633 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-03 08:57:02,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-03 08:57:02,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-03 08:57:02,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-03 08:57:02,654 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-03 08:57:02,657 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-03 08:57:02,679 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/.tmp/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26 2023-08-03 08:57:02,681 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/.tmp/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26 empty. 2023-08-03 08:57:02,682 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/.tmp/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26 2023-08-03 08:57:02,682 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-03 08:57:02,710 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-03 08:57:02,712 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c6c8082ccb1f514a2753ad161b5d7e26, NAME => 'hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/.tmp 2023-08-03 08:57:02,727 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:02,727 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c6c8082ccb1f514a2753ad161b5d7e26, disabling compactions & flushes 2023-08-03 08:57:02,727 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. 2023-08-03 08:57:02,727 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. 2023-08-03 08:57:02,727 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. after waiting 0 ms 2023-08-03 08:57:02,727 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. 2023-08-03 08:57:02,727 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. 2023-08-03 08:57:02,727 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c6c8082ccb1f514a2753ad161b5d7e26: 2023-08-03 08:57:02,732 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-03 08:57:02,746 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691053022735"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691053022735"}]},"ts":"1691053022735"} 2023-08-03 08:57:02,773 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-03 08:57:02,775 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-03 08:57:02,780 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053022775"}]},"ts":"1691053022775"} 2023-08-03 08:57:02,786 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-03 08:57:02,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c6c8082ccb1f514a2753ad161b5d7e26, ASSIGN}] 2023-08-03 08:57:02,798 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c6c8082ccb1f514a2753ad161b5d7e26, ASSIGN 2023-08-03 08:57:02,800 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c6c8082ccb1f514a2753ad161b5d7e26, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34599,1691053020898; forceNewPlan=false, retain=false 2023-08-03 08:57:02,951 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c6c8082ccb1f514a2753ad161b5d7e26, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:02,951 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691053022951"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691053022951"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691053022951"}]},"ts":"1691053022951"} 2023-08-03 08:57:02,956 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c6c8082ccb1f514a2753ad161b5d7e26, server=jenkins-hbase4.apache.org,34599,1691053020898}] 2023-08-03 08:57:03,116 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. 2023-08-03 08:57:03,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c6c8082ccb1f514a2753ad161b5d7e26, NAME => 'hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26.', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:57:03,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c6c8082ccb1f514a2753ad161b5d7e26 2023-08-03 08:57:03,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:03,119 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c6c8082ccb1f514a2753ad161b5d7e26 2023-08-03 08:57:03,119 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c6c8082ccb1f514a2753ad161b5d7e26 2023-08-03 08:57:03,122 INFO [StoreOpener-c6c8082ccb1f514a2753ad161b5d7e26-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c6c8082ccb1f514a2753ad161b5d7e26 2023-08-03 08:57:03,124 DEBUG [StoreOpener-c6c8082ccb1f514a2753ad161b5d7e26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26/info 2023-08-03 08:57:03,125 DEBUG [StoreOpener-c6c8082ccb1f514a2753ad161b5d7e26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26/info 2023-08-03 08:57:03,125 INFO [StoreOpener-c6c8082ccb1f514a2753ad161b5d7e26-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6c8082ccb1f514a2753ad161b5d7e26 columnFamilyName info 2023-08-03 08:57:03,126 INFO [StoreOpener-c6c8082ccb1f514a2753ad161b5d7e26-1] regionserver.HStore(310): Store=c6c8082ccb1f514a2753ad161b5d7e26/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:03,127 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26 2023-08-03 08:57:03,128 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26 2023-08-03 08:57:03,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c6c8082ccb1f514a2753ad161b5d7e26 2023-08-03 08:57:03,136 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:57:03,137 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c6c8082ccb1f514a2753ad161b5d7e26; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=800897, jitterRate=0.018394380807876587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:57:03,137 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c6c8082ccb1f514a2753ad161b5d7e26: 2023-08-03 08:57:03,139 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26., pid=6, masterSystemTime=1691053023110 2023-08-03 08:57:03,143 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. 2023-08-03 08:57:03,143 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. 2023-08-03 08:57:03,144 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c6c8082ccb1f514a2753ad161b5d7e26, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:03,145 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691053023144"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691053023144"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691053023144"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691053023144"}]},"ts":"1691053023144"} 2023-08-03 08:57:03,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-03 08:57:03,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c6c8082ccb1f514a2753ad161b5d7e26, server=jenkins-hbase4.apache.org,34599,1691053020898 in 192 msec 2023-08-03 08:57:03,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-03 08:57:03,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c6c8082ccb1f514a2753ad161b5d7e26, ASSIGN in 356 msec 2023-08-03 08:57:03,158 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-03 08:57:03,158 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053023158"}]},"ts":"1691053023158"} 2023-08-03 08:57:03,161 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-03 08:57:03,164 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-03 08:57:03,167 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 521 msec 2023-08-03 08:57:03,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-03 08:57:03,256 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-03 08:57:03,257 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:03,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-03 08:57:03,314 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-03 08:57:03,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-08-03 08:57:03,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-03 08:57:03,341 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-03 08:57:03,346 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-08-03 08:57:03,357 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-03 08:57:03,360 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-03 08:57:03,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.389sec 2023-08-03 08:57:03,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-03 08:57:03,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-03 08:57:03,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-03 08:57:03,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42383,1691053019751-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-03 08:57:03,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42383,1691053019751-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-03 08:57:03,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-03 08:57:03,442 DEBUG [Listener at localhost/33551] zookeeper.ReadOnlyZKClient(139): Connect 0x47551c5e to 127.0.0.1:63594 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-03 08:57:03,448 DEBUG [Listener at localhost/33551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14531676, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-03 08:57:03,489 DEBUG [hconnection-0x73a1b4fe-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-03 08:57:03,501 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-03 08:57:03,512 INFO [Listener at localhost/33551] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42383,1691053019751 2023-08-03 08:57:03,512 INFO [Listener at localhost/33551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:03,519 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-03 08:57:03,519 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:03,520 INFO [Listener at localhost/33551] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-03 08:57:03,534 WARN [Listener at localhost/33551] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-03 08:57:03,538 WARN [Listener at localhost/33551] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:57:03,540 INFO [Listener at localhost/33551] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:57:03,546 INFO [Listener at localhost/33551] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/java.io.tmpdir/Jetty_localhost_45313_datanode____msur17/webapp 2023-08-03 08:57:03,646 INFO [Listener at localhost/33551] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45313 2023-08-03 08:57:03,658 WARN [Listener at localhost/35381] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:57:03,681 WARN [Listener at localhost/35381] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-03 08:57:03,684 WARN [Listener at localhost/35381] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:57:03,685 INFO [Listener at localhost/35381] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:57:03,690 INFO [Listener at localhost/35381] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/java.io.tmpdir/Jetty_localhost_37383_datanode____.3ynhjj/webapp 2023-08-03 08:57:03,769 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb1755fe40a39df4a: Processing first storage report for DS-7be2bf5e-bc37-4909-89ce-cbd5765f92b6 from datanode 98b66b67-265c-42a0-8b54-1cf16ba9d6f6 2023-08-03 08:57:03,769 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb1755fe40a39df4a: from storage DS-7be2bf5e-bc37-4909-89ce-cbd5765f92b6 node DatanodeRegistration(127.0.0.1:45705, datanodeUuid=98b66b67-265c-42a0-8b54-1cf16ba9d6f6, infoPort=40327, infoSecurePort=0, ipcPort=35381, storageInfo=lv=-57;cid=testClusterID;nsid=911681346;c=1691053016781), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:57:03,769 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb1755fe40a39df4a: Processing first storage report for DS-f4b434ca-f2a0-4ba7-bc14-e44ec3700a46 from datanode 98b66b67-265c-42a0-8b54-1cf16ba9d6f6 2023-08-03 08:57:03,769 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb1755fe40a39df4a: from storage DS-f4b434ca-f2a0-4ba7-bc14-e44ec3700a46 node DatanodeRegistration(127.0.0.1:45705, datanodeUuid=98b66b67-265c-42a0-8b54-1cf16ba9d6f6, infoPort=40327, infoSecurePort=0, ipcPort=35381, storageInfo=lv=-57;cid=testClusterID;nsid=911681346;c=1691053016781), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:57:03,796 INFO [Listener at localhost/35381] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37383 2023-08-03 08:57:03,805 WARN [Listener at localhost/41643] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:57:03,824 WARN [Listener at localhost/41643] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-03 08:57:03,829 WARN [Listener at localhost/41643] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:57:03,831 INFO [Listener at localhost/41643] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:57:03,837 INFO [Listener at localhost/41643] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/java.io.tmpdir/Jetty_localhost_33697_datanode____5t0a57/webapp 2023-08-03 08:57:03,970 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x23443fabb0d4d5d1: Processing first storage report for DS-ad768541-2d40-4c69-82d6-84aaee2a53df from datanode 3926590e-c9e1-4c7e-8181-72c757b200fe 2023-08-03 08:57:03,970 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x23443fabb0d4d5d1: from storage DS-ad768541-2d40-4c69-82d6-84aaee2a53df node DatanodeRegistration(127.0.0.1:33995, datanodeUuid=3926590e-c9e1-4c7e-8181-72c757b200fe, infoPort=43225, infoSecurePort=0, ipcPort=41643, storageInfo=lv=-57;cid=testClusterID;nsid=911681346;c=1691053016781), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:57:03,970 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x23443fabb0d4d5d1: Processing first storage report for DS-544c6751-f17d-4b97-bce1-846252dd6588 from datanode 3926590e-c9e1-4c7e-8181-72c757b200fe 2023-08-03 08:57:03,970 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x23443fabb0d4d5d1: from storage DS-544c6751-f17d-4b97-bce1-846252dd6588 node DatanodeRegistration(127.0.0.1:33995, datanodeUuid=3926590e-c9e1-4c7e-8181-72c757b200fe, infoPort=43225, infoSecurePort=0, ipcPort=41643, storageInfo=lv=-57;cid=testClusterID;nsid=911681346;c=1691053016781), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:57:03,995 INFO [Listener at localhost/41643] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33697 2023-08-03 08:57:04,008 WARN [Listener at localhost/42927] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:57:04,119 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf50cc88327dbf533: Processing first storage report for DS-475e9157-ea9f-4cae-b9ff-cabf7acfb69e from datanode febdc8fd-cdd0-4ec3-b612-d5d3c0d1fad3 2023-08-03 08:57:04,119 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf50cc88327dbf533: from storage DS-475e9157-ea9f-4cae-b9ff-cabf7acfb69e node DatanodeRegistration(127.0.0.1:33343, datanodeUuid=febdc8fd-cdd0-4ec3-b612-d5d3c0d1fad3, infoPort=37873, infoSecurePort=0, ipcPort=42927, storageInfo=lv=-57;cid=testClusterID;nsid=911681346;c=1691053016781), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:57:04,119 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf50cc88327dbf533: Processing first storage report for DS-85d48024-7fa3-434d-8f3f-b55203ae97cf from datanode febdc8fd-cdd0-4ec3-b612-d5d3c0d1fad3 2023-08-03 08:57:04,119 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf50cc88327dbf533: from storage DS-85d48024-7fa3-434d-8f3f-b55203ae97cf node DatanodeRegistration(127.0.0.1:33343, datanodeUuid=febdc8fd-cdd0-4ec3-b612-d5d3c0d1fad3, infoPort=37873, infoSecurePort=0, ipcPort=42927, storageInfo=lv=-57;cid=testClusterID;nsid=911681346;c=1691053016781), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-03 08:57:04,129 DEBUG [Listener at localhost/42927] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-03 08:57:04,133 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-03 08:57:04,141 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42383] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-03 08:57:04,141 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42383] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-03 08:57:04,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42383] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-03 08:57:04,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42383] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath 2023-08-03 08:57:04,149 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_PRE_OPERATION 2023-08-03 08:57:04,150 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-03 08:57:04,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42383] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRollOnDatanodeDeath" procId is: 9 2023-08-03 08:57:04,153 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710 2023-08-03 08:57:04,155 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710 empty. 2023-08-03 08:57:04,157 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710 2023-08-03 08:57:04,157 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRollOnDatanodeDeath regions 2023-08-03 08:57:04,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42383] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-03 08:57:04,179 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/.tabledesc/.tableinfo.0000000001 2023-08-03 08:57:04,180 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(7675): creating {ENCODED => 00342f8b778b2d771f0ea571d8b3b710, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/.tmp 2023-08-03 08:57:04,197 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:04,197 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1604): Closing 00342f8b778b2d771f0ea571d8b3b710, disabling compactions & flushes 2023-08-03 08:57:04,197 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:04,197 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:04,197 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. after waiting 0 ms 2023-08-03 08:57:04,197 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:04,197 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:04,197 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1558): Region close journal for 00342f8b778b2d771f0ea571d8b3b710: 2023-08-03 08:57:04,201 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ADD_TO_META 2023-08-03 08:57:04,203 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1691053024203"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691053024203"}]},"ts":"1691053024203"} 2023-08-03 08:57:04,206 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-03 08:57:04,207 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-03 08:57:04,207 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053024207"}]},"ts":"1691053024207"} 2023-08-03 08:57:04,210 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLING in hbase:meta 2023-08-03 08:57:04,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=00342f8b778b2d771f0ea571d8b3b710, ASSIGN}] 2023-08-03 08:57:04,217 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=00342f8b778b2d771f0ea571d8b3b710, ASSIGN 2023-08-03 08:57:04,218 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=00342f8b778b2d771f0ea571d8b3b710, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34599,1691053020898; forceNewPlan=false, retain=false 2023-08-03 08:57:04,370 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=00342f8b778b2d771f0ea571d8b3b710, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:04,370 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1691053024369"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691053024369"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691053024369"}]},"ts":"1691053024369"} 2023-08-03 08:57:04,373 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 00342f8b778b2d771f0ea571d8b3b710, server=jenkins-hbase4.apache.org,34599,1691053020898}] 2023-08-03 08:57:04,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:04,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 00342f8b778b2d771f0ea571d8b3b710, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710.', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:57:04,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRollOnDatanodeDeath 00342f8b778b2d771f0ea571d8b3b710 2023-08-03 08:57:04,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:04,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 00342f8b778b2d771f0ea571d8b3b710 2023-08-03 08:57:04,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 00342f8b778b2d771f0ea571d8b3b710 2023-08-03 08:57:04,537 INFO [StoreOpener-00342f8b778b2d771f0ea571d8b3b710-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 00342f8b778b2d771f0ea571d8b3b710 2023-08-03 08:57:04,539 DEBUG [StoreOpener-00342f8b778b2d771f0ea571d8b3b710-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710/info 2023-08-03 08:57:04,539 DEBUG [StoreOpener-00342f8b778b2d771f0ea571d8b3b710-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710/info 2023-08-03 08:57:04,540 INFO [StoreOpener-00342f8b778b2d771f0ea571d8b3b710-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00342f8b778b2d771f0ea571d8b3b710 columnFamilyName info 2023-08-03 08:57:04,541 INFO [StoreOpener-00342f8b778b2d771f0ea571d8b3b710-1] regionserver.HStore(310): Store=00342f8b778b2d771f0ea571d8b3b710/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:04,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710 2023-08-03 08:57:04,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710 2023-08-03 08:57:04,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 00342f8b778b2d771f0ea571d8b3b710 2023-08-03 08:57:04,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:57:04,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 00342f8b778b2d771f0ea571d8b3b710; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=883304, jitterRate=0.12317994236946106}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:57:04,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 00342f8b778b2d771f0ea571d8b3b710: 2023-08-03 08:57:04,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710., pid=11, masterSystemTime=1691053024527 2023-08-03 08:57:04,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:04,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:04,556 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=00342f8b778b2d771f0ea571d8b3b710, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:04,556 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1691053024556"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691053024556"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691053024556"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691053024556"}]},"ts":"1691053024556"} 2023-08-03 08:57:04,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-03 08:57:04,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 00342f8b778b2d771f0ea571d8b3b710, server=jenkins-hbase4.apache.org,34599,1691053020898 in 186 msec 2023-08-03 08:57:04,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-03 08:57:04,566 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=00342f8b778b2d771f0ea571d8b3b710, ASSIGN in 348 msec 2023-08-03 08:57:04,567 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-03 08:57:04,567 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053024567"}]},"ts":"1691053024567"} 2023-08-03 08:57:04,569 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLED in hbase:meta 2023-08-03 08:57:04,572 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_POST_OPERATION 2023-08-03 08:57:04,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath in 427 msec 2023-08-03 08:57:07,963 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-03 08:57:08,043 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-03 08:57:08,044 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-03 08:57:08,045 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRollOnDatanodeDeath' 2023-08-03 08:57:09,904 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-03 08:57:09,905 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-08-03 08:57:14,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42383] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-03 08:57:14,168 INFO [Listener at localhost/42927] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRollOnDatanodeDeath, procId: 9 completed 2023-08-03 08:57:14,168 DEBUG [Listener at localhost/42927] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestLogRolling-testLogRollOnDatanodeDeath get assigned. Timeout = 60000ms 2023-08-03 08:57:14,169 INFO [Listener at localhost/42927] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-08-03 08:57:14,173 INFO [Listener at localhost/42927] hbase.HBaseTestingUtility(3484): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned to meta. Checking AM states. 2023-08-03 08:57:14,174 INFO [Listener at localhost/42927] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-08-03 08:57:14,174 INFO [Listener at localhost/42927] hbase.HBaseTestingUtility(3504): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned. 2023-08-03 08:57:14,183 DEBUG [Listener at localhost/42927] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRollOnDatanodeDeath 2023-08-03 08:57:14,184 DEBUG [Listener at localhost/42927] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:14,185 WARN [Listener at localhost/42927] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-03 08:57:14,192 INFO [Listener at localhost/42927] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:57:14,194 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-855821969_17 at /127.0.0.1:50564 [Receiving block BP-355899344-172.31.14.131-1691053016781:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:34965:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:50564 dst: /127.0.0.1:34965 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:14,194 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-671671193_17 at /127.0.0.1:50522 [Receiving block BP-355899344-172.31.14.131-1691053016781:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:34965:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:50522 dst: /127.0.0.1:34965 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:14,194 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-855821969_17 at /127.0.0.1:50538 [Receiving block BP-355899344-172.31.14.131-1691053016781:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:34965:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:50538 dst: /127.0.0.1:34965 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:14,295 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-671671193_17 at /127.0.0.1:47124 [Receiving block BP-355899344-172.31.14.131-1691053016781:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:40185:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:47124 dst: /127.0.0.1:40185 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:14,296 WARN [BP-355899344-172.31.14.131-1691053016781 heartbeating to localhost/127.0.0.1:36349] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-03 08:57:14,295 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-855821969_17 at /127.0.0.1:47160 [Receiving block BP-355899344-172.31.14.131-1691053016781:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:40185:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:47160 dst: /127.0.0.1:40185 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:14,295 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-855821969_17 at /127.0.0.1:47164 [Receiving block BP-355899344-172.31.14.131-1691053016781:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:40185:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:47164 dst: /127.0.0.1:40185 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:14,296 WARN [BP-355899344-172.31.14.131-1691053016781 heartbeating to localhost/127.0.0.1:36349] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-355899344-172.31.14.131-1691053016781 (Datanode Uuid 8ea1ff26-8523-4324-b563-8966fb9d1bd0) service to localhost/127.0.0.1:36349 2023-08-03 08:57:14,299 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/dfs/data/data3/current/BP-355899344-172.31.14.131-1691053016781] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:57:14,299 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/dfs/data/data4/current/BP-355899344-172.31.14.131-1691053016781] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:57:14,307 WARN [Listener at localhost/42927] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-03 08:57:14,309 WARN [Listener at localhost/42927] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:57:14,310 INFO [Listener at localhost/42927] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:57:14,315 INFO [Listener at localhost/42927] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/java.io.tmpdir/Jetty_localhost_33039_datanode____.wam3mr/webapp 2023-08-03 08:57:14,406 INFO [Listener at localhost/42927] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33039 2023-08-03 08:57:14,414 WARN [Listener at localhost/35501] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:57:14,418 WARN [AsyncFSWAL-0-hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e-prefix:jenkins-hbase4.apache.org,34599,1691053020898] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:14,420 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C34599%2C1691053020898:(num 1691053022235) roll requested 2023-08-03 08:57:14,437 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33343,DS-475e9157-ea9f-4cae-b9ff-cabf7acfb69e,DISK] 2023-08-03 08:57:14,437 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45705,DS-7be2bf5e-bc37-4909-89ce-cbd5765f92b6,DISK] 2023-08-03 08:57:14,442 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.1691053022235 with entries=6, filesize=3.19 KB; new WAL /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.1691053034420 2023-08-03 08:57:14,443 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33343,DS-475e9157-ea9f-4cae-b9ff-cabf7acfb69e,DISK], DatanodeInfoWithStorage[127.0.0.1:45705,DS-7be2bf5e-bc37-4909-89ce-cbd5765f92b6,DISK]] 2023-08-03 08:57:14,443 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.1691053022235 is not closed yet, will try archiving it next time 2023-08-03 08:57:14,444 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-03 08:57:14,445 INFO [Listener at localhost/35501] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-03 08:57:14,446 DEBUG [Listener at localhost/35501] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47551c5e to 127.0.0.1:63594 2023-08-03 08:57:14,446 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:14,446 DEBUG [Listener at localhost/35501] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:57:14,446 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:14,447 DEBUG [Listener at localhost/35501] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-03 08:57:14,447 DEBUG [Listener at localhost/35501] util.JVMClusterUtil(257): Found active master hash=115348766, stopped=false 2023-08-03 08:57:14,447 INFO [Listener at localhost/35501] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42383,1691053019751 2023-08-03 08:57:14,449 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-03 08:57:14,449 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-03 08:57:14,449 INFO [Listener at localhost/35501] procedure2.ProcedureExecutor(629): Stopping 2023-08-03 08:57:14,449 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:14,450 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.1691053022235 2023-08-03 08:57:14,450 DEBUG [Listener at localhost/35501] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48e92653 to 127.0.0.1:63594 2023-08-03 08:57:14,450 DEBUG [Listener at localhost/35501] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:57:14,451 INFO [Listener at localhost/35501] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34599,1691053020898' ***** 2023-08-03 08:57:14,451 INFO [Listener at localhost/35501] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-03 08:57:14,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:57:14,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:57:14,451 INFO [RS:0;jenkins-hbase4:34599] regionserver.HeapMemoryManager(220): Stopping 2023-08-03 08:57:14,451 INFO [RS:0;jenkins-hbase4:34599] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-03 08:57:14,451 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-03 08:57:14,452 INFO [RS:0;jenkins-hbase4:34599] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-03 08:57:14,452 INFO [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(3305): Received CLOSE for 00342f8b778b2d771f0ea571d8b3b710 2023-08-03 08:57:14,453 INFO [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(3305): Received CLOSE for c6c8082ccb1f514a2753ad161b5d7e26 2023-08-03 08:57:14,453 INFO [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:14,453 DEBUG [RS:0;jenkins-hbase4:34599] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b29c64b to 127.0.0.1:63594 2023-08-03 08:57:14,454 DEBUG [RS:0;jenkins-hbase4:34599] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:57:14,454 INFO [RS:0;jenkins-hbase4:34599] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-03 08:57:14,454 INFO [RS:0;jenkins-hbase4:34599] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-03 08:57:14,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 00342f8b778b2d771f0ea571d8b3b710, disabling compactions & flushes 2023-08-03 08:57:14,454 INFO [RS:0;jenkins-hbase4:34599] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-03 08:57:14,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:14,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:14,455 INFO [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-03 08:57:14,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. after waiting 0 ms 2023-08-03 08:57:14,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:14,455 INFO [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-08-03 08:57:14,455 DEBUG [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1478): Online Regions={00342f8b778b2d771f0ea571d8b3b710=TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710., 1588230740=hbase:meta,,1.1588230740, c6c8082ccb1f514a2753ad161b5d7e26=hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26.} 2023-08-03 08:57:14,456 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-03 08:57:14,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-03 08:57:14,456 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-03 08:57:14,456 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-03 08:57:14,456 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-03 08:57:14,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 00342f8b778b2d771f0ea571d8b3b710 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-08-03 08:57:14,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.92 KB heapSize=5.45 KB 2023-08-03 08:57:14,456 WARN [IPC Server handler 2 on default port 36349] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.1691053022235 has not been closed. Lease recovery is in progress. RecoveryId = 1015 for block blk_1073741832_1008 2023-08-03 08:57:14,457 DEBUG [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1504): Waiting on 00342f8b778b2d771f0ea571d8b3b710, 1588230740, c6c8082ccb1f514a2753ad161b5d7e26 2023-08-03 08:57:14,459 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.1691053022235 after 9ms 2023-08-03 08:57:14,466 WARN [AsyncFSWAL-0-hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e-prefix:jenkins-hbase4.apache.org,34599,1691053020898.meta] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:14,467 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta:.meta(num 1691053022399) roll requested 2023-08-03 08:57:14,486 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34965,DS-f9035294-4731-45e6-baeb-fc48a96e8fd9,DISK] 2023-08-03 08:57:14,486 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45705,DS-7be2bf5e-bc37-4909-89ce-cbd5765f92b6,DISK] 2023-08-03 08:57:14,492 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta.1691053022399.meta with entries=12, filesize=3.87 KB; new WAL /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta.1691053034468.meta 2023-08-03 08:57:14,492 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34965,DS-f9035294-4731-45e6-baeb-fc48a96e8fd9,DISK], DatanodeInfoWithStorage[127.0.0.1:45705,DS-7be2bf5e-bc37-4909-89ce-cbd5765f92b6,DISK]] 2023-08-03 08:57:14,492 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta.1691053022399.meta is not closed yet, will try archiving it next time 2023-08-03 08:57:14,493 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:14,494 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:14,495 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta.1691053022399.meta 2023-08-03 08:57:14,496 WARN [IPC Server handler 0 on default port 36349] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta.1691053022399.meta has not been closed. Lease recovery is in progress. RecoveryId = 1017 for block blk_1073741833_1009 2023-08-03 08:57:14,497 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta.1691053022399.meta after 2ms 2023-08-03 08:57:14,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710/.tmp/info/8b50504e3b4946dc988d1f5995d7db9f 2023-08-03 08:57:14,551 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.69 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/.tmp/info/456243bf66f249dba26b3b8dff1aca3f 2023-08-03 08:57:14,561 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4a43e24bdd602fb: Processing first storage report for DS-abdf04a7-f6cc-4261-9d5a-fbfbb2413d16 from datanode 8ea1ff26-8523-4324-b563-8966fb9d1bd0 2023-08-03 08:57:14,562 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4a43e24bdd602fb: from storage DS-abdf04a7-f6cc-4261-9d5a-fbfbb2413d16 node DatanodeRegistration(127.0.0.1:35575, datanodeUuid=8ea1ff26-8523-4324-b563-8966fb9d1bd0, infoPort=40081, infoSecurePort=0, ipcPort=35501, storageInfo=lv=-57;cid=testClusterID;nsid=911681346;c=1691053016781), blocks: 5, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-03 08:57:14,562 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4a43e24bdd602fb: Processing first storage report for DS-1e86c27a-37b0-4f93-8fb5-2eb5b07e2c64 from datanode 8ea1ff26-8523-4324-b563-8966fb9d1bd0 2023-08-03 08:57:14,562 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4a43e24bdd602fb: from storage DS-1e86c27a-37b0-4f93-8fb5-2eb5b07e2c64 node DatanodeRegistration(127.0.0.1:35575, datanodeUuid=8ea1ff26-8523-4324-b563-8966fb9d1bd0, infoPort=40081, infoSecurePort=0, ipcPort=35501, storageInfo=lv=-57;cid=testClusterID;nsid=911681346;c=1691053016781), blocks: 6, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:57:14,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710/.tmp/info/8b50504e3b4946dc988d1f5995d7db9f as hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710/info/8b50504e3b4946dc988d1f5995d7db9f 2023-08-03 08:57:14,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710/info/8b50504e3b4946dc988d1f5995d7db9f, entries=2, sequenceid=6, filesize=6.8 K 2023-08-03 08:57:14,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for 00342f8b778b2d771f0ea571d8b3b710 in 163ms, sequenceid=6, compaction requested=false 2023-08-03 08:57:14,622 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=240 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/.tmp/table/4c282baabd7a47be95a1e3b74ac5702f 2023-08-03 08:57:14,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/default/TestLogRolling-testLogRollOnDatanodeDeath/00342f8b778b2d771f0ea571d8b3b710/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-03 08:57:14,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:14,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 00342f8b778b2d771f0ea571d8b3b710: 2023-08-03 08:57:14,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1691053024141.00342f8b778b2d771f0ea571d8b3b710. 2023-08-03 08:57:14,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c6c8082ccb1f514a2753ad161b5d7e26, disabling compactions & flushes 2023-08-03 08:57:14,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. 2023-08-03 08:57:14,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. 2023-08-03 08:57:14,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. after waiting 0 ms 2023-08-03 08:57:14,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. 2023-08-03 08:57:14,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c6c8082ccb1f514a2753ad161b5d7e26 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-03 08:57:14,635 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/.tmp/info/456243bf66f249dba26b3b8dff1aca3f as hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/info/456243bf66f249dba26b3b8dff1aca3f 2023-08-03 08:57:14,648 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/info/456243bf66f249dba26b3b8dff1aca3f, entries=20, sequenceid=14, filesize=7.4 K 2023-08-03 08:57:14,654 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/.tmp/table/4c282baabd7a47be95a1e3b74ac5702f as hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/table/4c282baabd7a47be95a1e3b74ac5702f 2023-08-03 08:57:14,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26/.tmp/info/e672f2b52741459ba70f40c2b87a0457 2023-08-03 08:57:14,658 DEBUG [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1504): Waiting on 1588230740, c6c8082ccb1f514a2753ad161b5d7e26 2023-08-03 08:57:14,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/table/4c282baabd7a47be95a1e3b74ac5702f, entries=4, sequenceid=14, filesize=4.8 K 2023-08-03 08:57:14,666 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.92 KB/2994, heapSize ~5.16 KB/5288, currentSize=0 B/0 for 1588230740 in 210ms, sequenceid=14, compaction requested=false 2023-08-03 08:57:14,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26/.tmp/info/e672f2b52741459ba70f40c2b87a0457 as hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26/info/e672f2b52741459ba70f40c2b87a0457 2023-08-03 08:57:14,676 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-08-03 08:57:14,677 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-03 08:57:14,678 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-03 08:57:14,678 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-03 08:57:14,678 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-03 08:57:14,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26/info/e672f2b52741459ba70f40c2b87a0457, entries=2, sequenceid=6, filesize=4.8 K 2023-08-03 08:57:14,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c6c8082ccb1f514a2753ad161b5d7e26 in 49ms, sequenceid=6, compaction requested=false 2023-08-03 08:57:14,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/data/hbase/namespace/c6c8082ccb1f514a2753ad161b5d7e26/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-03 08:57:14,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. 2023-08-03 08:57:14,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c6c8082ccb1f514a2753ad161b5d7e26: 2023-08-03 08:57:14,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1691053022641.c6c8082ccb1f514a2753ad161b5d7e26. 2023-08-03 08:57:14,858 INFO [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34599,1691053020898; all regions closed. 2023-08-03 08:57:15,081 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-03 08:57:15,081 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-03 08:57:16,085 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-03 08:57:18,460 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.1691053022235 after 4010ms 2023-08-03 08:57:18,461 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.1691053022235 to hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/oldWALs/jenkins-hbase4.apache.org%2C34599%2C1691053020898.1691053022235 2023-08-03 08:57:18,497 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta.1691053022399.meta after 4002ms 2023-08-03 08:57:18,498 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/WALs/jenkins-hbase4.apache.org,34599,1691053020898/jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta.1691053022399.meta to hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/oldWALs/jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta.1691053022399.meta 2023-08-03 08:57:18,504 DEBUG [RS:0;jenkins-hbase4:34599] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/oldWALs 2023-08-03 08:57:18,504 INFO [RS:0;jenkins-hbase4:34599] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34599%2C1691053020898.meta:.meta(num 1691053034468) 2023-08-03 08:57:18,513 DEBUG [RS:0;jenkins-hbase4:34599] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/oldWALs 2023-08-03 08:57:18,513 INFO [RS:0;jenkins-hbase4:34599] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34599%2C1691053020898:(num 1691053034420) 2023-08-03 08:57:18,513 DEBUG [RS:0;jenkins-hbase4:34599] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:57:18,513 INFO [RS:0;jenkins-hbase4:34599] regionserver.LeaseManager(133): Closed leases 2023-08-03 08:57:18,513 INFO [RS:0;jenkins-hbase4:34599] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-03 08:57:18,513 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-03 08:57:18,514 INFO [RS:0;jenkins-hbase4:34599] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34599 2023-08-03 08:57:18,521 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34599,1691053020898 2023-08-03 08:57:18,521 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-03 08:57:18,521 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-03 08:57:18,523 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34599,1691053020898] 2023-08-03 08:57:18,523 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34599,1691053020898; numProcessing=1 2023-08-03 08:57:18,525 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34599,1691053020898 already deleted, retry=false 2023-08-03 08:57:18,525 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34599,1691053020898 expired; onlineServers=0 2023-08-03 08:57:18,525 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42383,1691053019751' ***** 2023-08-03 08:57:18,525 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-03 08:57:18,526 DEBUG [M:0;jenkins-hbase4:42383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47dd1f25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-03 08:57:18,526 INFO [M:0;jenkins-hbase4:42383] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42383,1691053019751 2023-08-03 08:57:18,526 INFO [M:0;jenkins-hbase4:42383] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42383,1691053019751; all regions closed. 2023-08-03 08:57:18,526 DEBUG [M:0;jenkins-hbase4:42383] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:57:18,526 DEBUG [M:0;jenkins-hbase4:42383] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-03 08:57:18,526 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-03 08:57:18,526 DEBUG [M:0;jenkins-hbase4:42383] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-03 08:57:18,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691053021916] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691053021916,5,FailOnTimeoutGroup] 2023-08-03 08:57:18,527 INFO [M:0;jenkins-hbase4:42383] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-03 08:57:18,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691053021915] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691053021915,5,FailOnTimeoutGroup] 2023-08-03 08:57:18,528 INFO [M:0;jenkins-hbase4:42383] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-03 08:57:18,529 INFO [M:0;jenkins-hbase4:42383] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-03 08:57:18,529 DEBUG [M:0;jenkins-hbase4:42383] master.HMaster(1512): Stopping service threads 2023-08-03 08:57:18,529 INFO [M:0;jenkins-hbase4:42383] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-03 08:57:18,530 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-03 08:57:18,530 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:18,530 ERROR [M:0;jenkins-hbase4:42383] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] 2023-08-03 08:57:18,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-03 08:57:18,531 INFO [M:0;jenkins-hbase4:42383] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-03 08:57:18,531 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-03 08:57:18,531 DEBUG [M:0;jenkins-hbase4:42383] zookeeper.ZKUtil(398): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-03 08:57:18,531 WARN [M:0;jenkins-hbase4:42383] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-03 08:57:18,531 INFO [M:0;jenkins-hbase4:42383] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-03 08:57:18,532 INFO [M:0;jenkins-hbase4:42383] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-03 08:57:18,532 DEBUG [M:0;jenkins-hbase4:42383] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-03 08:57:18,532 INFO [M:0;jenkins-hbase4:42383] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:57:18,532 DEBUG [M:0;jenkins-hbase4:42383] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:57:18,532 DEBUG [M:0;jenkins-hbase4:42383] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-03 08:57:18,532 DEBUG [M:0;jenkins-hbase4:42383] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:57:18,532 INFO [M:0;jenkins-hbase4:42383] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.08 KB heapSize=45.73 KB 2023-08-03 08:57:18,533 WARN [AsyncFSWAL-0-hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData-prefix:jenkins-hbase4.apache.org,42383,1691053019751] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:18,533 DEBUG [master:store-WAL-Roller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C42383%2C1691053019751:(num 1691053021320) roll requested 2023-08-03 08:57:18,551 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35575,DS-abdf04a7-f6cc-4261-9d5a-fbfbb2413d16,DISK] 2023-08-03 08:57:18,551 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34965,DS-f9035294-4731-45e6-baeb-fc48a96e8fd9,DISK] 2023-08-03 08:57:18,556 INFO [master:store-WAL-Roller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/WALs/jenkins-hbase4.apache.org,42383,1691053019751/jenkins-hbase4.apache.org%2C42383%2C1691053019751.1691053021320 with entries=89, filesize=43.93 KB; new WAL /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/WALs/jenkins-hbase4.apache.org,42383,1691053019751/jenkins-hbase4.apache.org%2C42383%2C1691053019751.1691053038533 2023-08-03 08:57:18,556 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35575,DS-abdf04a7-f6cc-4261-9d5a-fbfbb2413d16,DISK], DatanodeInfoWithStorage[127.0.0.1:34965,DS-f9035294-4731-45e6-baeb-fc48a96e8fd9,DISK]] 2023-08-03 08:57:18,556 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:18,556 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(716): hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/WALs/jenkins-hbase4.apache.org,42383,1691053019751/jenkins-hbase4.apache.org%2C42383%2C1691053019751.1691053021320 is not closed yet, will try archiving it next time 2023-08-03 08:57:18,557 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-03 08:57:18,557 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/WALs/jenkins-hbase4.apache.org,42383,1691053019751/jenkins-hbase4.apache.org%2C42383%2C1691053019751.1691053021320 2023-08-03 08:57:18,558 WARN [IPC Server handler 1 on default port 36349] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/WALs/jenkins-hbase4.apache.org,42383,1691053019751/jenkins-hbase4.apache.org%2C42383%2C1691053019751.1691053021320 has not been closed. Lease recovery is in progress. RecoveryId = 1023 for block blk_1073741829_1005 2023-08-03 08:57:18,558 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/WALs/jenkins-hbase4.apache.org,42383,1691053019751/jenkins-hbase4.apache.org%2C42383%2C1691053019751.1691053021320 after 1ms 2023-08-03 08:57:18,574 INFO [M:0;jenkins-hbase4:42383] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.08 KB at sequenceid=91 (bloomFilter=true), to=hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1264b427b483491eafe8cbd6ccf58ffe 2023-08-03 08:57:18,582 DEBUG [M:0;jenkins-hbase4:42383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1264b427b483491eafe8cbd6ccf58ffe as hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1264b427b483491eafe8cbd6ccf58ffe 2023-08-03 08:57:18,590 INFO [M:0;jenkins-hbase4:42383] regionserver.HStore(1080): Added hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1264b427b483491eafe8cbd6ccf58ffe, entries=11, sequenceid=91, filesize=7.0 K 2023-08-03 08:57:18,591 INFO [M:0;jenkins-hbase4:42383] regionserver.HRegion(2948): Finished flush of dataSize ~38.08 KB/38997, heapSize ~45.72 KB/46816, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 59ms, sequenceid=91, compaction requested=false 2023-08-03 08:57:18,595 INFO [M:0;jenkins-hbase4:42383] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:57:18,595 DEBUG [M:0;jenkins-hbase4:42383] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-03 08:57:18,623 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:57:18,623 INFO [RS:0;jenkins-hbase4:34599] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34599,1691053020898; zookeeper connection closed. 2023-08-03 08:57:18,624 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): regionserver:34599-0x101ca0bd2290001, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:57:18,624 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6b1e09a8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6b1e09a8 2023-08-03 08:57:18,625 INFO [Listener at localhost/35501] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-03 08:57:20,166 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-03 08:57:20,210 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-03 08:57:22,559 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/WALs/jenkins-hbase4.apache.org,42383,1691053019751/jenkins-hbase4.apache.org%2C42383%2C1691053019751.1691053021320 after 4002ms 2023-08-03 08:57:22,560 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/WALs/jenkins-hbase4.apache.org,42383,1691053019751/jenkins-hbase4.apache.org%2C42383%2C1691053019751.1691053021320 to hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/oldWALs/jenkins-hbase4.apache.org%2C42383%2C1691053019751.1691053021320 2023-08-03 08:57:22,566 INFO [WAL-Archive-0] region.MasterRegionUtils(50): Moved hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/MasterData/oldWALs/jenkins-hbase4.apache.org%2C42383%2C1691053019751.1691053021320 to hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/oldWALs/jenkins-hbase4.apache.org%2C42383%2C1691053019751.1691053021320$masterlocalwal$ 2023-08-03 08:57:22,566 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-03 08:57:22,566 INFO [M:0;jenkins-hbase4:42383] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-03 08:57:22,567 INFO [M:0;jenkins-hbase4:42383] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42383 2023-08-03 08:57:22,569 DEBUG [M:0;jenkins-hbase4:42383] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42383,1691053019751 already deleted, retry=false 2023-08-03 08:57:22,671 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:57:22,671 INFO [M:0;jenkins-hbase4:42383] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42383,1691053019751; zookeeper connection closed. 2023-08-03 08:57:22,671 DEBUG [Listener at localhost/33551-EventThread] zookeeper.ZKWatcher(600): master:42383-0x101ca0bd2290000, quorum=127.0.0.1:63594, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:57:22,673 WARN [Listener at localhost/35501] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-03 08:57:22,677 INFO [Listener at localhost/35501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:57:22,781 WARN [BP-355899344-172.31.14.131-1691053016781 heartbeating to localhost/127.0.0.1:36349] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-03 08:57:22,781 WARN [BP-355899344-172.31.14.131-1691053016781 heartbeating to localhost/127.0.0.1:36349] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-355899344-172.31.14.131-1691053016781 (Datanode Uuid 8ea1ff26-8523-4324-b563-8966fb9d1bd0) service to localhost/127.0.0.1:36349 2023-08-03 08:57:22,781 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/dfs/data/data3/current/BP-355899344-172.31.14.131-1691053016781] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:57:22,782 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/dfs/data/data4/current/BP-355899344-172.31.14.131-1691053016781] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:57:22,784 WARN [Listener at localhost/35501] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-03 08:57:22,788 INFO [Listener at localhost/35501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:57:22,891 WARN [BP-355899344-172.31.14.131-1691053016781 heartbeating to localhost/127.0.0.1:36349] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-03 08:57:22,891 WARN [BP-355899344-172.31.14.131-1691053016781 heartbeating to localhost/127.0.0.1:36349] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-355899344-172.31.14.131-1691053016781 (Datanode Uuid febdc8fd-cdd0-4ec3-b612-d5d3c0d1fad3) service to localhost/127.0.0.1:36349 2023-08-03 08:57:22,892 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/dfs/data/data9/current/BP-355899344-172.31.14.131-1691053016781] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:57:22,892 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/dfs/data/data10/current/BP-355899344-172.31.14.131-1691053016781] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:57:22,894 WARN [Listener at localhost/35501] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-03 08:57:22,897 INFO [Listener at localhost/35501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:57:23,001 WARN [BP-355899344-172.31.14.131-1691053016781 heartbeating to localhost/127.0.0.1:36349] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-03 08:57:23,001 WARN [BP-355899344-172.31.14.131-1691053016781 heartbeating to localhost/127.0.0.1:36349] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-355899344-172.31.14.131-1691053016781 (Datanode Uuid 3926590e-c9e1-4c7e-8181-72c757b200fe) service to localhost/127.0.0.1:36349 2023-08-03 08:57:23,001 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/dfs/data/data7/current/BP-355899344-172.31.14.131-1691053016781] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:57:23,002 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/dfs/data/data8/current/BP-355899344-172.31.14.131-1691053016781] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:57:23,003 WARN [Listener at localhost/35501] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-03 08:57:23,006 INFO [Listener at localhost/35501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:57:23,109 WARN [BP-355899344-172.31.14.131-1691053016781 heartbeating to localhost/127.0.0.1:36349] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-03 08:57:23,109 WARN [BP-355899344-172.31.14.131-1691053016781 heartbeating to localhost/127.0.0.1:36349] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-355899344-172.31.14.131-1691053016781 (Datanode Uuid 98b66b67-265c-42a0-8b54-1cf16ba9d6f6) service to localhost/127.0.0.1:36349 2023-08-03 08:57:23,110 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/dfs/data/data5/current/BP-355899344-172.31.14.131-1691053016781] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:57:23,110 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/dfs/data/data6/current/BP-355899344-172.31.14.131-1691053016781] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:57:23,111 WARN [Listener at localhost/35501] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-03 08:57:23,113 INFO [Listener at localhost/35501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:57:23,214 WARN [BP-355899344-172.31.14.131-1691053016781 heartbeating to localhost/127.0.0.1:36349] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-03 08:57:23,214 WARN [BP-355899344-172.31.14.131-1691053016781 heartbeating to localhost/127.0.0.1:36349] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-355899344-172.31.14.131-1691053016781 (Datanode Uuid 1a4cd756-a3d3-4e7f-9608-d4ffbd91f8cd) service to localhost/127.0.0.1:36349 2023-08-03 08:57:23,215 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/dfs/data/data1/current/BP-355899344-172.31.14.131-1691053016781] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:57:23,215 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/cluster_c8579815-5df3-4017-9fea-b38feab84680/dfs/data/data2/current/BP-355899344-172.31.14.131-1691053016781] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:57:23,248 INFO [Listener at localhost/35501] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:57:23,364 INFO [Listener at localhost/35501] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-03 08:57:23,411 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-03 08:57:23,424 INFO [Listener at localhost/35501] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=77 (was 10) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36349 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@694b2b56 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:36349 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (269345645) connection to localhost/127.0.0.1:36349 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35501 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (269345645) connection to localhost/127.0.0.1:36349 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (269345645) connection to localhost/127.0.0.1:36349 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) - Thread LEAK? -, OpenFileDescriptor=470 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=177 (was 238), ProcessCount=176 (was 176), AvailableMemoryMB=1191 (was 1821) 2023-08-03 08:57:23,434 INFO [Listener at localhost/35501] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=77, OpenFileDescriptor=470, MaxFileDescriptor=60000, SystemLoadAverage=177, ProcessCount=176, AvailableMemoryMB=1191 2023-08-03 08:57:23,434 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-03 08:57:23,434 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/hadoop.log.dir so I do NOT create it in target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb 2023-08-03 08:57:23,434 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2a5d22f3-2371-875f-1d1d-645922e2d3a6/hadoop.tmp.dir so I do NOT create it in target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb 2023-08-03 08:57:23,434 INFO [Listener at localhost/35501] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/cluster_f9b0a787-a45a-52dc-46c8-206911ed99fd, deleteOnExit=true 2023-08-03 08:57:23,435 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-03 08:57:23,435 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/test.cache.data in system properties and HBase conf 2023-08-03 08:57:23,435 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/hadoop.tmp.dir in system properties and HBase conf 2023-08-03 08:57:23,435 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/hadoop.log.dir in system properties and HBase conf 2023-08-03 08:57:23,435 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-03 08:57:23,435 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-03 08:57:23,435 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-03 08:57:23,435 DEBUG [Listener at localhost/35501] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-03 08:57:23,436 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-03 08:57:23,436 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-03 08:57:23,436 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-03 08:57:23,436 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-03 08:57:23,436 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-03 08:57:23,436 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-03 08:57:23,436 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-03 08:57:23,437 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-03 08:57:23,437 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-03 08:57:23,437 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/nfs.dump.dir in system properties and HBase conf 2023-08-03 08:57:23,437 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/java.io.tmpdir in system properties and HBase conf 2023-08-03 08:57:23,438 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-03 08:57:23,438 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-03 08:57:23,438 INFO [Listener at localhost/35501] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-03 08:57:23,445 WARN [Listener at localhost/35501] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-03 08:57:23,446 WARN [Listener at localhost/35501] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-03 08:57:23,493 WARN [Listener at localhost/35501] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:57:23,496 INFO [Listener at localhost/35501] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:57:23,500 INFO [Listener at localhost/35501] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/java.io.tmpdir/Jetty_localhost_37357_hdfs____xtpfx7/webapp 2023-08-03 08:57:23,594 INFO [Listener at localhost/35501] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37357 2023-08-03 08:57:23,602 WARN [Listener at localhost/35501] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-03 08:57:23,602 WARN [Listener at localhost/35501] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-03 08:57:23,647 WARN [Listener at localhost/36709] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:57:23,660 WARN [Listener at localhost/36709] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-03 08:57:23,662 WARN [Listener at localhost/36709] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:57:23,663 INFO [Listener at localhost/36709] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:57:23,668 INFO [Listener at localhost/36709] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/java.io.tmpdir/Jetty_localhost_40339_datanode____j6jq6c/webapp 2023-08-03 08:57:23,763 INFO [Listener at localhost/36709] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40339 2023-08-03 08:57:23,770 WARN [Listener at localhost/38171] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:57:23,784 WARN [Listener at localhost/38171] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-03 08:57:23,787 WARN [Listener at localhost/38171] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:57:23,788 INFO [Listener at localhost/38171] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:57:23,792 INFO [Listener at localhost/38171] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/java.io.tmpdir/Jetty_localhost_42705_datanode____4gd1yd/webapp 2023-08-03 08:57:23,872 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8bff49eb162613a9: Processing first storage report for DS-64280f20-f72f-4eca-beb7-5bf889f754e6 from datanode 784fb68c-d067-4b6c-aecc-03029d9e7b75 2023-08-03 08:57:23,872 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8bff49eb162613a9: from storage DS-64280f20-f72f-4eca-beb7-5bf889f754e6 node DatanodeRegistration(127.0.0.1:37945, datanodeUuid=784fb68c-d067-4b6c-aecc-03029d9e7b75, infoPort=42551, infoSecurePort=0, ipcPort=38171, storageInfo=lv=-57;cid=testClusterID;nsid=1688903464;c=1691053043451), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:57:23,872 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8bff49eb162613a9: Processing first storage report for DS-155ba8f6-778f-4629-b37e-ef2a9919ef05 from datanode 784fb68c-d067-4b6c-aecc-03029d9e7b75 2023-08-03 08:57:23,872 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8bff49eb162613a9: from storage DS-155ba8f6-778f-4629-b37e-ef2a9919ef05 node DatanodeRegistration(127.0.0.1:37945, datanodeUuid=784fb68c-d067-4b6c-aecc-03029d9e7b75, infoPort=42551, infoSecurePort=0, ipcPort=38171, storageInfo=lv=-57;cid=testClusterID;nsid=1688903464;c=1691053043451), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:57:23,894 INFO [Listener at localhost/38171] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42705 2023-08-03 08:57:23,902 WARN [Listener at localhost/37641] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:57:23,998 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9a459a7e9c0eae84: Processing first storage report for DS-4c787860-c479-4d58-843d-7f07e2d3da32 from datanode 68f81bd4-e423-437b-b625-c32a331869ae 2023-08-03 08:57:23,998 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9a459a7e9c0eae84: from storage DS-4c787860-c479-4d58-843d-7f07e2d3da32 node DatanodeRegistration(127.0.0.1:35719, datanodeUuid=68f81bd4-e423-437b-b625-c32a331869ae, infoPort=43489, infoSecurePort=0, ipcPort=37641, storageInfo=lv=-57;cid=testClusterID;nsid=1688903464;c=1691053043451), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:57:23,998 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9a459a7e9c0eae84: Processing first storage report for DS-9cfd4b05-5ea0-4a52-b9d3-759bd9dd0563 from datanode 68f81bd4-e423-437b-b625-c32a331869ae 2023-08-03 08:57:23,998 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9a459a7e9c0eae84: from storage DS-9cfd4b05-5ea0-4a52-b9d3-759bd9dd0563 node DatanodeRegistration(127.0.0.1:35719, datanodeUuid=68f81bd4-e423-437b-b625-c32a331869ae, infoPort=43489, infoSecurePort=0, ipcPort=37641, storageInfo=lv=-57;cid=testClusterID;nsid=1688903464;c=1691053043451), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:57:24,010 DEBUG [Listener at localhost/37641] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb 2023-08-03 08:57:24,013 INFO [Listener at localhost/37641] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/cluster_f9b0a787-a45a-52dc-46c8-206911ed99fd/zookeeper_0, clientPort=64787, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/cluster_f9b0a787-a45a-52dc-46c8-206911ed99fd/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/cluster_f9b0a787-a45a-52dc-46c8-206911ed99fd/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-03 08:57:24,015 INFO [Listener at localhost/37641] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64787 2023-08-03 08:57:24,016 INFO [Listener at localhost/37641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:24,017 INFO [Listener at localhost/37641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:24,033 INFO [Listener at localhost/37641] util.FSUtils(471): Created version file at hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54 with version=8 2023-08-03 08:57:24,033 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/hbase-staging 2023-08-03 08:57:24,035 INFO [Listener at localhost/37641] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-03 08:57:24,035 INFO [Listener at localhost/37641] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:57:24,035 INFO [Listener at localhost/37641] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-03 08:57:24,035 INFO [Listener at localhost/37641] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-03 08:57:24,035 INFO [Listener at localhost/37641] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:57:24,036 INFO [Listener at localhost/37641] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-03 08:57:24,036 INFO [Listener at localhost/37641] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-03 08:57:24,037 INFO [Listener at localhost/37641] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37979 2023-08-03 08:57:24,037 INFO [Listener at localhost/37641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:24,039 INFO [Listener at localhost/37641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:24,040 INFO [Listener at localhost/37641] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37979 connecting to ZooKeeper ensemble=127.0.0.1:64787 2023-08-03 08:57:24,046 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:379790x0, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-03 08:57:24,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37979-0x101ca0c34300000 connected 2023-08-03 08:57:24,066 DEBUG [Listener at localhost/37641] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-03 08:57:24,066 DEBUG [Listener at localhost/37641] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:57:24,067 DEBUG [Listener at localhost/37641] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-03 08:57:24,067 DEBUG [Listener at localhost/37641] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37979 2023-08-03 08:57:24,067 DEBUG [Listener at localhost/37641] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37979 2023-08-03 08:57:24,068 DEBUG [Listener at localhost/37641] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37979 2023-08-03 08:57:24,068 DEBUG [Listener at localhost/37641] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37979 2023-08-03 08:57:24,068 DEBUG [Listener at localhost/37641] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37979 2023-08-03 08:57:24,068 INFO [Listener at localhost/37641] master.HMaster(444): hbase.rootdir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54, hbase.cluster.distributed=false 2023-08-03 08:57:24,084 INFO [Listener at localhost/37641] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-03 08:57:24,085 INFO [Listener at localhost/37641] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:57:24,085 INFO [Listener at localhost/37641] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-03 08:57:24,085 INFO [Listener at localhost/37641] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-03 08:57:24,085 INFO [Listener at localhost/37641] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:57:24,085 INFO [Listener at localhost/37641] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-03 08:57:24,085 INFO [Listener at localhost/37641] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-03 08:57:24,088 INFO [Listener at localhost/37641] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36381 2023-08-03 08:57:24,088 INFO [Listener at localhost/37641] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-03 08:57:24,089 DEBUG [Listener at localhost/37641] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-03 08:57:24,090 INFO [Listener at localhost/37641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:24,092 INFO [Listener at localhost/37641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:24,093 INFO [Listener at localhost/37641] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36381 connecting to ZooKeeper ensemble=127.0.0.1:64787 2023-08-03 08:57:24,097 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:363810x0, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-03 08:57:24,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36381-0x101ca0c34300001 connected 2023-08-03 08:57:24,098 DEBUG [Listener at localhost/37641] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-03 08:57:24,098 DEBUG [Listener at localhost/37641] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:57:24,099 DEBUG [Listener at localhost/37641] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-03 08:57:24,101 DEBUG [Listener at localhost/37641] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36381 2023-08-03 08:57:24,102 DEBUG [Listener at localhost/37641] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36381 2023-08-03 08:57:24,103 DEBUG [Listener at localhost/37641] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36381 2023-08-03 08:57:24,103 DEBUG [Listener at localhost/37641] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36381 2023-08-03 08:57:24,103 DEBUG [Listener at localhost/37641] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36381 2023-08-03 08:57:24,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37979,1691053044035 2023-08-03 08:57:24,106 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-03 08:57:24,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37979,1691053044035 2023-08-03 08:57:24,108 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-03 08:57:24,108 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-03 08:57:24,108 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:24,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-03 08:57:24,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37979,1691053044035 from backup master directory 2023-08-03 08:57:24,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-03 08:57:24,112 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37979,1691053044035 2023-08-03 08:57:24,112 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-03 08:57:24,112 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-03 08:57:24,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37979,1691053044035 2023-08-03 08:57:24,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/hbase.id with ID: 818c8305-ace5-410c-925a-35ab8ce5dc75 2023-08-03 08:57:24,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:24,146 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:24,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x466002a9 to 127.0.0.1:64787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-03 08:57:24,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62580ac9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-03 08:57:24,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-03 08:57:24,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-03 08:57:24,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:57:24,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/data/master/store-tmp 2023-08-03 08:57:24,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:24,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-03 08:57:24,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:57:24,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:57:24,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-03 08:57:24,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:57:24,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:57:24,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-03 08:57:24,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/WALs/jenkins-hbase4.apache.org,37979,1691053044035 2023-08-03 08:57:24,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37979%2C1691053044035, suffix=, logDir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/WALs/jenkins-hbase4.apache.org,37979,1691053044035, archiveDir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/oldWALs, maxLogs=10 2023-08-03 08:57:24,193 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35719,DS-4c787860-c479-4d58-843d-7f07e2d3da32,DISK] 2023-08-03 08:57:24,194 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37945,DS-64280f20-f72f-4eca-beb7-5bf889f754e6,DISK] 2023-08-03 08:57:24,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/WALs/jenkins-hbase4.apache.org,37979,1691053044035/jenkins-hbase4.apache.org%2C37979%2C1691053044035.1691053044179 2023-08-03 08:57:24,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35719,DS-4c787860-c479-4d58-843d-7f07e2d3da32,DISK], DatanodeInfoWithStorage[127.0.0.1:37945,DS-64280f20-f72f-4eca-beb7-5bf889f754e6,DISK]] 2023-08-03 08:57:24,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:57:24,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:24,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:57:24,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:57:24,199 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:57:24,200 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-03 08:57:24,201 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-03 08:57:24,202 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:24,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:57:24,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:57:24,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:57:24,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:57:24,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=776515, jitterRate=-0.01261119544506073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:57:24,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-03 08:57:24,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-03 08:57:24,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-03 08:57:24,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-03 08:57:24,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-03 08:57:24,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-03 08:57:24,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-03 08:57:24,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-03 08:57:24,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-03 08:57:24,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-03 08:57:24,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-03 08:57:24,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-03 08:57:24,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-03 08:57:24,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-03 08:57:24,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-03 08:57:24,231 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:24,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-03 08:57:24,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-03 08:57:24,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-03 08:57:24,235 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-03 08:57:24,235 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-03 08:57:24,235 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:24,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37979,1691053044035, sessionid=0x101ca0c34300000, setting cluster-up flag (Was=false) 2023-08-03 08:57:24,240 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:24,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-03 08:57:24,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37979,1691053044035 2023-08-03 08:57:24,250 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:24,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-03 08:57:24,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37979,1691053044035 2023-08-03 08:57:24,256 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/.hbase-snapshot/.tmp 2023-08-03 08:57:24,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-03 08:57:24,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:57:24,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:57:24,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:57:24,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:57:24,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-03 08:57:24,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:24,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-03 08:57:24,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:24,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1691053074261 2023-08-03 08:57:24,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-03 08:57:24,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-03 08:57:24,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-03 08:57:24,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-03 08:57:24,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-03 08:57:24,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-03 08:57:24,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-03 08:57:24,262 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-03 08:57:24,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-03 08:57:24,262 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-03 08:57:24,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-03 08:57:24,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-03 08:57:24,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-03 08:57:24,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691053044263,5,FailOnTimeoutGroup] 2023-08-03 08:57:24,264 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-03 08:57:24,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691053044263,5,FailOnTimeoutGroup] 2023-08-03 08:57:24,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-03 08:57:24,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,285 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-03 08:57:24,286 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-03 08:57:24,286 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54 2023-08-03 08:57:24,296 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:24,298 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-03 08:57:24,300 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/info 2023-08-03 08:57:24,301 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-03 08:57:24,301 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:24,301 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-03 08:57:24,303 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/rep_barrier 2023-08-03 08:57:24,304 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-03 08:57:24,305 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:24,305 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-03 08:57:24,306 INFO [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(951): ClusterId : 818c8305-ace5-410c-925a-35ab8ce5dc75 2023-08-03 08:57:24,307 DEBUG [RS:0;jenkins-hbase4:36381] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-03 08:57:24,308 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/table 2023-08-03 08:57:24,308 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-03 08:57:24,309 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:24,309 DEBUG [RS:0;jenkins-hbase4:36381] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-03 08:57:24,310 DEBUG [RS:0;jenkins-hbase4:36381] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-03 08:57:24,311 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740 2023-08-03 08:57:24,311 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740 2023-08-03 08:57:24,313 DEBUG [RS:0;jenkins-hbase4:36381] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-03 08:57:24,314 DEBUG [RS:0;jenkins-hbase4:36381] zookeeper.ReadOnlyZKClient(139): Connect 0x7e9339a4 to 127.0.0.1:64787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-03 08:57:24,316 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-03 08:57:24,318 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-03 08:57:24,320 DEBUG [RS:0;jenkins-hbase4:36381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7054d806, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-03 08:57:24,320 DEBUG [RS:0;jenkins-hbase4:36381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@746b52d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-03 08:57:24,321 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:57:24,322 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=778812, jitterRate=-0.009689927101135254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-03 08:57:24,322 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-03 08:57:24,323 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-03 08:57:24,323 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-03 08:57:24,323 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-03 08:57:24,323 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-03 08:57:24,323 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-03 08:57:24,323 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-03 08:57:24,323 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-03 08:57:24,325 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-03 08:57:24,325 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-03 08:57:24,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-03 08:57:24,327 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-03 08:57:24,328 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-03 08:57:24,331 DEBUG [RS:0;jenkins-hbase4:36381] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36381 2023-08-03 08:57:24,331 INFO [RS:0;jenkins-hbase4:36381] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-03 08:57:24,331 INFO [RS:0;jenkins-hbase4:36381] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-03 08:57:24,331 DEBUG [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(1022): About to register with Master. 2023-08-03 08:57:24,332 INFO [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37979,1691053044035 with isa=jenkins-hbase4.apache.org/172.31.14.131:36381, startcode=1691053044084 2023-08-03 08:57:24,332 DEBUG [RS:0;jenkins-hbase4:36381] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-03 08:57:24,335 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49359, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-08-03 08:57:24,336 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37979] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:24,336 DEBUG [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54 2023-08-03 08:57:24,336 DEBUG [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36709 2023-08-03 08:57:24,336 DEBUG [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-03 08:57:24,338 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-03 08:57:24,339 DEBUG [RS:0;jenkins-hbase4:36381] zookeeper.ZKUtil(162): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:24,339 WARN [RS:0;jenkins-hbase4:36381] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-03 08:57:24,339 INFO [RS:0;jenkins-hbase4:36381] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:57:24,339 DEBUG [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:24,339 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36381,1691053044084] 2023-08-03 08:57:24,343 DEBUG [RS:0;jenkins-hbase4:36381] zookeeper.ZKUtil(162): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:24,344 DEBUG [RS:0;jenkins-hbase4:36381] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-03 08:57:24,345 INFO [RS:0;jenkins-hbase4:36381] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-03 08:57:24,347 INFO [RS:0;jenkins-hbase4:36381] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-03 08:57:24,348 INFO [RS:0;jenkins-hbase4:36381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-03 08:57:24,348 INFO [RS:0;jenkins-hbase4:36381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,348 INFO [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-03 08:57:24,350 INFO [RS:0;jenkins-hbase4:36381] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,350 DEBUG [RS:0;jenkins-hbase4:36381] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:24,350 DEBUG [RS:0;jenkins-hbase4:36381] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:24,350 DEBUG [RS:0;jenkins-hbase4:36381] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:24,350 DEBUG [RS:0;jenkins-hbase4:36381] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:24,350 DEBUG [RS:0;jenkins-hbase4:36381] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:24,350 DEBUG [RS:0;jenkins-hbase4:36381] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-03 08:57:24,350 DEBUG [RS:0;jenkins-hbase4:36381] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:24,350 DEBUG [RS:0;jenkins-hbase4:36381] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:24,350 DEBUG [RS:0;jenkins-hbase4:36381] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:24,350 DEBUG [RS:0;jenkins-hbase4:36381] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:57:24,351 INFO [RS:0;jenkins-hbase4:36381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,351 INFO [RS:0;jenkins-hbase4:36381] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,351 INFO [RS:0;jenkins-hbase4:36381] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,367 INFO [RS:0;jenkins-hbase4:36381] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-03 08:57:24,367 INFO [RS:0;jenkins-hbase4:36381] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36381,1691053044084-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,380 INFO [RS:0;jenkins-hbase4:36381] regionserver.Replication(203): jenkins-hbase4.apache.org,36381,1691053044084 started 2023-08-03 08:57:24,380 INFO [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36381,1691053044084, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36381, sessionid=0x101ca0c34300001 2023-08-03 08:57:24,380 DEBUG [RS:0;jenkins-hbase4:36381] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-03 08:57:24,380 DEBUG [RS:0;jenkins-hbase4:36381] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:24,380 DEBUG [RS:0;jenkins-hbase4:36381] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36381,1691053044084' 2023-08-03 08:57:24,380 DEBUG [RS:0;jenkins-hbase4:36381] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:57:24,381 DEBUG [RS:0;jenkins-hbase4:36381] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:57:24,381 DEBUG [RS:0;jenkins-hbase4:36381] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-03 08:57:24,381 DEBUG [RS:0;jenkins-hbase4:36381] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-03 08:57:24,381 DEBUG [RS:0;jenkins-hbase4:36381] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:24,381 DEBUG [RS:0;jenkins-hbase4:36381] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36381,1691053044084' 2023-08-03 08:57:24,381 DEBUG [RS:0;jenkins-hbase4:36381] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-03 08:57:24,381 DEBUG [RS:0;jenkins-hbase4:36381] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-03 08:57:24,382 DEBUG [RS:0;jenkins-hbase4:36381] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-03 08:57:24,382 INFO [RS:0;jenkins-hbase4:36381] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-03 08:57:24,382 INFO [RS:0;jenkins-hbase4:36381] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-03 08:57:24,478 DEBUG [jenkins-hbase4:37979] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-03 08:57:24,479 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36381,1691053044084, state=OPENING 2023-08-03 08:57:24,481 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-03 08:57:24,484 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:24,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36381,1691053044084}] 2023-08-03 08:57:24,484 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-03 08:57:24,485 INFO [RS:0;jenkins-hbase4:36381] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36381%2C1691053044084, suffix=, logDir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084, archiveDir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/oldWALs, maxLogs=32 2023-08-03 08:57:24,505 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35719,DS-4c787860-c479-4d58-843d-7f07e2d3da32,DISK] 2023-08-03 08:57:24,505 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37945,DS-64280f20-f72f-4eca-beb7-5bf889f754e6,DISK] 2023-08-03 08:57:24,507 INFO [RS:0;jenkins-hbase4:36381] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053044487 2023-08-03 08:57:24,508 DEBUG [RS:0;jenkins-hbase4:36381] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35719,DS-4c787860-c479-4d58-843d-7f07e2d3da32,DISK], DatanodeInfoWithStorage[127.0.0.1:37945,DS-64280f20-f72f-4eca-beb7-5bf889f754e6,DISK]] 2023-08-03 08:57:24,639 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:24,640 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-03 08:57:24,642 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-03 08:57:24,646 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-03 08:57:24,647 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:57:24,649 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36381%2C1691053044084.meta, suffix=.meta, logDir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084, archiveDir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/oldWALs, maxLogs=32 2023-08-03 08:57:24,665 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37945,DS-64280f20-f72f-4eca-beb7-5bf889f754e6,DISK] 2023-08-03 08:57:24,666 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35719,DS-4c787860-c479-4d58-843d-7f07e2d3da32,DISK] 2023-08-03 08:57:24,668 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.meta.1691053044650.meta 2023-08-03 08:57:24,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37945,DS-64280f20-f72f-4eca-beb7-5bf889f754e6,DISK], DatanodeInfoWithStorage[127.0.0.1:35719,DS-4c787860-c479-4d58-843d-7f07e2d3da32,DISK]] 2023-08-03 08:57:24,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:57:24,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-03 08:57:24,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-03 08:57:24,669 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-03 08:57:24,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-03 08:57:24,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:24,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-03 08:57:24,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-03 08:57:24,671 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-03 08:57:24,672 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/info 2023-08-03 08:57:24,673 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/info 2023-08-03 08:57:24,673 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-03 08:57:24,674 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:24,674 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-03 08:57:24,675 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/rep_barrier 2023-08-03 08:57:24,675 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/rep_barrier 2023-08-03 08:57:24,676 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-03 08:57:24,677 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:24,677 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-03 08:57:24,679 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/table 2023-08-03 08:57:24,679 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/table 2023-08-03 08:57:24,681 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-03 08:57:24,682 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:24,683 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740 2023-08-03 08:57:24,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740 2023-08-03 08:57:24,687 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-03 08:57:24,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-03 08:57:24,690 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=829400, jitterRate=0.054636940360069275}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-03 08:57:24,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-03 08:57:24,691 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1691053044639 2023-08-03 08:57:24,695 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-03 08:57:24,696 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-03 08:57:24,696 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36381,1691053044084, state=OPEN 2023-08-03 08:57:24,698 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-03 08:57:24,698 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-03 08:57:24,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-03 08:57:24,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36381,1691053044084 in 214 msec 2023-08-03 08:57:24,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-03 08:57:24,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 376 msec 2023-08-03 08:57:24,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 447 msec 2023-08-03 08:57:24,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1691053044706, completionTime=-1 2023-08-03 08:57:24,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-03 08:57:24,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-03 08:57:24,709 DEBUG [hconnection-0x78e924d7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-03 08:57:24,711 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-03 08:57:24,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-03 08:57:24,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1691053104713 2023-08-03 08:57:24,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1691053164713 2023-08-03 08:57:24,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 6 msec 2023-08-03 08:57:24,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37979,1691053044035-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37979,1691053044035-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37979,1691053044035-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37979, period=300000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-03 08:57:24,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-03 08:57:24,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-03 08:57:24,720 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-03 08:57:24,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-03 08:57:24,722 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-03 08:57:24,723 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-03 08:57:24,725 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/.tmp/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b 2023-08-03 08:57:24,726 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/.tmp/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b empty. 2023-08-03 08:57:24,726 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/.tmp/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b 2023-08-03 08:57:24,726 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-03 08:57:24,740 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-03 08:57:24,741 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d4c419c16edcf4ea6c941ac9f7d5058b, NAME => 'hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/.tmp 2023-08-03 08:57:24,754 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:24,754 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d4c419c16edcf4ea6c941ac9f7d5058b, disabling compactions & flushes 2023-08-03 08:57:24,754 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:57:24,754 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:57:24,754 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. after waiting 0 ms 2023-08-03 08:57:24,754 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:57:24,754 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:57:24,754 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d4c419c16edcf4ea6c941ac9f7d5058b: 2023-08-03 08:57:24,758 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-03 08:57:24,759 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691053044759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691053044759"}]},"ts":"1691053044759"} 2023-08-03 08:57:24,762 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-03 08:57:24,763 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-03 08:57:24,763 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053044763"}]},"ts":"1691053044763"} 2023-08-03 08:57:24,765 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-03 08:57:24,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d4c419c16edcf4ea6c941ac9f7d5058b, ASSIGN}] 2023-08-03 08:57:24,774 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d4c419c16edcf4ea6c941ac9f7d5058b, ASSIGN 2023-08-03 08:57:24,776 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d4c419c16edcf4ea6c941ac9f7d5058b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36381,1691053044084; forceNewPlan=false, retain=false 2023-08-03 08:57:24,926 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d4c419c16edcf4ea6c941ac9f7d5058b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:24,927 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691053044926"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691053044926"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691053044926"}]},"ts":"1691053044926"} 2023-08-03 08:57:24,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d4c419c16edcf4ea6c941ac9f7d5058b, server=jenkins-hbase4.apache.org,36381,1691053044084}] 2023-08-03 08:57:25,086 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:57:25,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d4c419c16edcf4ea6c941ac9f7d5058b, NAME => 'hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b.', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:57:25,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d4c419c16edcf4ea6c941ac9f7d5058b 2023-08-03 08:57:25,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:25,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d4c419c16edcf4ea6c941ac9f7d5058b 2023-08-03 08:57:25,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d4c419c16edcf4ea6c941ac9f7d5058b 2023-08-03 08:57:25,089 INFO [StoreOpener-d4c419c16edcf4ea6c941ac9f7d5058b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d4c419c16edcf4ea6c941ac9f7d5058b 2023-08-03 08:57:25,090 DEBUG [StoreOpener-d4c419c16edcf4ea6c941ac9f7d5058b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b/info 2023-08-03 08:57:25,091 DEBUG [StoreOpener-d4c419c16edcf4ea6c941ac9f7d5058b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b/info 2023-08-03 08:57:25,091 INFO [StoreOpener-d4c419c16edcf4ea6c941ac9f7d5058b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4c419c16edcf4ea6c941ac9f7d5058b columnFamilyName info 2023-08-03 08:57:25,092 INFO [StoreOpener-d4c419c16edcf4ea6c941ac9f7d5058b-1] regionserver.HStore(310): Store=d4c419c16edcf4ea6c941ac9f7d5058b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:25,093 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b 2023-08-03 08:57:25,094 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b 2023-08-03 08:57:25,138 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d4c419c16edcf4ea6c941ac9f7d5058b 2023-08-03 08:57:25,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:57:25,141 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d4c419c16edcf4ea6c941ac9f7d5058b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=862220, jitterRate=0.09637048840522766}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:57:25,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d4c419c16edcf4ea6c941ac9f7d5058b: 2023-08-03 08:57:25,143 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b., pid=6, masterSystemTime=1691053045082 2023-08-03 08:57:25,145 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:57:25,145 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:57:25,146 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d4c419c16edcf4ea6c941ac9f7d5058b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:25,146 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691053045146"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691053045146"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691053045146"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691053045146"}]},"ts":"1691053045146"} 2023-08-03 08:57:25,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-03 08:57:25,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d4c419c16edcf4ea6c941ac9f7d5058b, server=jenkins-hbase4.apache.org,36381,1691053044084 in 219 msec 2023-08-03 08:57:25,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-03 08:57:25,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d4c419c16edcf4ea6c941ac9f7d5058b, ASSIGN in 379 msec 2023-08-03 08:57:25,155 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-03 08:57:25,155 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053045155"}]},"ts":"1691053045155"} 2023-08-03 08:57:25,157 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-03 08:57:25,160 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-03 08:57:25,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 441 msec 2023-08-03 08:57:25,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-03 08:57:25,237 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-03 08:57:25,238 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:25,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-03 08:57:25,252 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-03 08:57:25,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-08-03 08:57:25,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-03 08:57:25,273 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-03 08:57:25,278 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-08-03 08:57:25,288 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-03 08:57:25,292 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-03 08:57:25,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.180sec 2023-08-03 08:57:25,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-03 08:57:25,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-03 08:57:25,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-03 08:57:25,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37979,1691053044035-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-03 08:57:25,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37979,1691053044035-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-03 08:57:25,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-03 08:57:25,336 DEBUG [Listener at localhost/37641] zookeeper.ReadOnlyZKClient(139): Connect 0x09b3403c to 127.0.0.1:64787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-03 08:57:25,340 DEBUG [Listener at localhost/37641] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f53368f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-03 08:57:25,342 DEBUG [hconnection-0x14a514cb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-03 08:57:25,344 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-03 08:57:25,345 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37979,1691053044035 2023-08-03 08:57:25,346 INFO [Listener at localhost/37641] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:57:25,349 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-03 08:57:25,349 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:57:25,350 INFO [Listener at localhost/37641] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-03 08:57:25,352 DEBUG [Listener at localhost/37641] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-03 08:57:25,354 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-03 08:57:25,356 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-03 08:57:25,356 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-03 08:57:25,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-03 08:57:25,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:25,360 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-08-03 08:57:25,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testCompactionRecordDoesntBlockRolling" procId is: 9 2023-08-03 08:57:25,361 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-03 08:57:25,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-03 08:57:25,364 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24 2023-08-03 08:57:25,365 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24 empty. 2023-08-03 08:57:25,365 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24 2023-08-03 08:57:25,365 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testCompactionRecordDoesntBlockRolling regions 2023-08-03 08:57:25,380 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/.tabledesc/.tableinfo.0000000001 2023-08-03 08:57:25,382 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => 72c9288c0939477ddb0a39dc699b3f24, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/.tmp 2023-08-03 08:57:25,391 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:25,391 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1604): Closing 72c9288c0939477ddb0a39dc699b3f24, disabling compactions & flushes 2023-08-03 08:57:25,392 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:57:25,392 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:57:25,392 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. after waiting 0 ms 2023-08-03 08:57:25,392 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:57:25,392 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:57:25,392 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1558): Region close journal for 72c9288c0939477ddb0a39dc699b3f24: 2023-08-03 08:57:25,395 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ADD_TO_META 2023-08-03 08:57:25,397 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1691053045396"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691053045396"}]},"ts":"1691053045396"} 2023-08-03 08:57:25,399 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-03 08:57:25,400 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-03 08:57:25,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053045400"}]},"ts":"1691053045400"} 2023-08-03 08:57:25,403 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLING in hbase:meta 2023-08-03 08:57:25,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=72c9288c0939477ddb0a39dc699b3f24, ASSIGN}] 2023-08-03 08:57:25,410 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=72c9288c0939477ddb0a39dc699b3f24, ASSIGN 2023-08-03 08:57:25,411 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=72c9288c0939477ddb0a39dc699b3f24, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36381,1691053044084; forceNewPlan=false, retain=false 2023-08-03 08:57:25,563 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=72c9288c0939477ddb0a39dc699b3f24, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:25,563 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1691053045563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691053045563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691053045563"}]},"ts":"1691053045563"} 2023-08-03 08:57:25,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 72c9288c0939477ddb0a39dc699b3f24, server=jenkins-hbase4.apache.org,36381,1691053044084}] 2023-08-03 08:57:25,713 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-03 08:57:25,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:57:25,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 72c9288c0939477ddb0a39dc699b3f24, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24.', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:57:25,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testCompactionRecordDoesntBlockRolling 72c9288c0939477ddb0a39dc699b3f24 2023-08-03 08:57:25,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:57:25,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 72c9288c0939477ddb0a39dc699b3f24 2023-08-03 08:57:25,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 72c9288c0939477ddb0a39dc699b3f24 2023-08-03 08:57:25,727 INFO [StoreOpener-72c9288c0939477ddb0a39dc699b3f24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 72c9288c0939477ddb0a39dc699b3f24 2023-08-03 08:57:25,729 DEBUG [StoreOpener-72c9288c0939477ddb0a39dc699b3f24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info 2023-08-03 08:57:25,729 DEBUG [StoreOpener-72c9288c0939477ddb0a39dc699b3f24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info 2023-08-03 08:57:25,730 INFO [StoreOpener-72c9288c0939477ddb0a39dc699b3f24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72c9288c0939477ddb0a39dc699b3f24 columnFamilyName info 2023-08-03 08:57:25,732 INFO [StoreOpener-72c9288c0939477ddb0a39dc699b3f24-1] regionserver.HStore(310): Store=72c9288c0939477ddb0a39dc699b3f24/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:57:25,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24 2023-08-03 08:57:25,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24 2023-08-03 08:57:25,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 72c9288c0939477ddb0a39dc699b3f24 2023-08-03 08:57:25,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:57:25,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 72c9288c0939477ddb0a39dc699b3f24; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=817605, jitterRate=0.03963959217071533}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:57:25,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 72c9288c0939477ddb0a39dc699b3f24: 2023-08-03 08:57:25,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24., pid=11, masterSystemTime=1691053045718 2023-08-03 08:57:25,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:57:25,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:57:25,745 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=72c9288c0939477ddb0a39dc699b3f24, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:25,746 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1691053045745"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691053045745"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691053045745"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691053045745"}]},"ts":"1691053045745"} 2023-08-03 08:57:25,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-03 08:57:25,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 72c9288c0939477ddb0a39dc699b3f24, server=jenkins-hbase4.apache.org,36381,1691053044084 in 184 msec 2023-08-03 08:57:25,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-03 08:57:25,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=72c9288c0939477ddb0a39dc699b3f24, ASSIGN in 344 msec 2023-08-03 08:57:25,756 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-03 08:57:25,756 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053045756"}]},"ts":"1691053045756"} 2023-08-03 08:57:25,758 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLED in hbase:meta 2023-08-03 08:57:25,761 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_POST_OPERATION 2023-08-03 08:57:25,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling in 404 msec 2023-08-03 08:57:29,904 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-03 08:57:29,904 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-08-03 08:57:30,345 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-03 08:57:30,345 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-03 08:57:30,346 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-03 08:57:31,228 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-03 08:57:35,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-03 08:57:35,364 INFO [Listener at localhost/37641] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testCompactionRecordDoesntBlockRolling, procId: 9 completed 2023-08-03 08:57:35,367 DEBUG [Listener at localhost/37641] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:35,367 DEBUG [Listener at localhost/37641] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:57:35,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-03 08:57:35,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] procedure.ProcedureCoordinator(165): Submitting procedure hbase:namespace 2023-08-03 08:57:35,387 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase:namespace' 2023-08-03 08:57:35,387 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-03 08:57:35,388 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase:namespace' starting 'acquire' 2023-08-03 08:57:35,388 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase:namespace', kicking off acquire phase on members. 2023-08-03 08:57:35,388 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-08-03 08:57:35,388 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-03 08:57:35,390 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,390 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-03 08:57:35,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-03 08:57:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:57:35,390 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,390 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-03 08:57:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase:namespace 2023-08-03 08:57:35,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-08-03 08:57:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-03 08:57:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-03 08:57:35,392 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase:namespace 2023-08-03 08:57:35,393 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase:namespace 2023-08-03 08:57:35,394 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase:namespace' with timeout 60000ms 2023-08-03 08:57:35,394 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-03 08:57:35,394 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase:namespace' starting 'acquire' stage 2023-08-03 08:57:35,395 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-03 08:57:35,395 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-03 08:57:35,395 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:57:35,395 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. started... 2023-08-03 08:57:35,395 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d4c419c16edcf4ea6c941ac9f7d5058b 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-03 08:57:35,410 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b/.tmp/info/057d1910f0c941869580ec1bc8d30398 2023-08-03 08:57:35,422 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b/.tmp/info/057d1910f0c941869580ec1bc8d30398 as hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b/info/057d1910f0c941869580ec1bc8d30398 2023-08-03 08:57:35,429 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b/info/057d1910f0c941869580ec1bc8d30398, entries=2, sequenceid=6, filesize=4.8 K 2023-08-03 08:57:35,430 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d4c419c16edcf4ea6c941ac9f7d5058b in 35ms, sequenceid=6, compaction requested=false 2023-08-03 08:57:35,431 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d4c419c16edcf4ea6c941ac9f7d5058b: 2023-08-03 08:57:35,431 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:57:35,431 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-03 08:57:35,431 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-03 08:57:35,431 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,431 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase:namespace' locally acquired 2023-08-03 08:57:35,431 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36381,1691053044084' joining acquired barrier for procedure (hbase:namespace) in zk 2023-08-03 08:57:35,435 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,435 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-03 08:57:35,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:57:35,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:57:35,435 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace 2023-08-03 08:57:35,435 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase:namespace' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-03 08:57:35,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:57:35,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:57:35,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-03 08:57:35,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:57:35,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36381,1691053044084' joining acquired barrier for procedure 'hbase:namespace' on coordinator 2023-08-03 08:57:35,437 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase:namespace' starting 'in-barrier' execution. 2023-08-03 08:57:35,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62a70f1[Count = 0] remaining members to acquire global barrier 2023-08-03 08:57:35,437 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-03 08:57:35,439 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-03 08:57:35,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-03 08:57:35,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-03 08:57:35,440 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase:namespace' received 'reached' from coordinator. 2023-08-03 08:57:35,440 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,440 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-03 08:57:35,440 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase:namespace' locally completed 2023-08-03 08:57:35,440 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase:namespace' completed for member 'jenkins-hbase4.apache.org,36381,1691053044084' in zk 2023-08-03 08:57:35,441 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase:namespace' has notified controller of completion 2023-08-03 08:57:35,441 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,441 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-03 08:57:35,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:57:35,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:57:35,441 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase:namespace' completed. 2023-08-03 08:57:35,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:57:35,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:57:35,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-03 08:57:35,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:57:35,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-03 08:57:35,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase:namespace' member 'jenkins-hbase4.apache.org,36381,1691053044084': 2023-08-03 08:57:35,445 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase:namespace' execution completed 2023-08-03 08:57:35,445 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-03 08:57:35,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36381,1691053044084' released barrier for procedure'hbase:namespace', counting down latch. Waiting for 0 more 2023-08-03 08:57:35,445 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-03 08:57:35,445 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase:namespace 2023-08-03 08:57:35,445 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase:namespaceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-03 08:57:35,447 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-03 08:57:35,447 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-03 08:57:35,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase:namespace 2023-08-03 08:57:35,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:57:35,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:57:35,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase:namespace 2023-08-03 08:57:35,447 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-03 08:57:35,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-08-03 08:57:35,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:57:35,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-03 08:57:35,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:57:35,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-03 08:57:35,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-08-03 08:57:35,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:57:35,450 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-03 08:57:35,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:57:35,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-03 08:57:35,451 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,457 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,457 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-03 08:57:35,457 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-03 08:57:35,458 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-03 08:57:35,458 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-03 08:57:35,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-03 08:57:35,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:57:35,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase:namespace' 2023-08-03 08:57:35,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-03 08:57:35,458 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:35,458 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-03 08:57:35,458 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-03 08:57:35,459 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-03 08:57:35,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-03 08:57:35,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:57:35,459 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-03 08:57:35,460 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase:namespace'' to complete. (max 20000 ms per retry) 2023-08-03 08:57:35,460 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-03 08:57:45,461 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-03 08:57:45,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-03 08:57:45,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-03 08:57:45,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,480 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-03 08:57:45,480 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-03 08:57:45,481 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-03 08:57:45,481 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-03 08:57:45,481 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,481 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,483 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,483 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-03 08:57:45,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-03 08:57:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:57:45,483 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,484 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-03 08:57:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-03 08:57:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,485 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,485 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,485 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-03 08:57:45,485 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-03 08:57:45,485 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-03 08:57:45,487 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-03 08:57:45,487 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-03 08:57:45,487 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:57:45,487 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. started... 2023-08-03 08:57:45,487 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72c9288c0939477ddb0a39dc699b3f24 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-03 08:57:45,503 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/.tmp/info/91936b3462b24761a5c33320482f13b0 2023-08-03 08:57:45,511 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/.tmp/info/91936b3462b24761a5c33320482f13b0 as hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/91936b3462b24761a5c33320482f13b0 2023-08-03 08:57:45,518 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/91936b3462b24761a5c33320482f13b0, entries=1, sequenceid=5, filesize=5.8 K 2023-08-03 08:57:45,519 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 72c9288c0939477ddb0a39dc699b3f24 in 32ms, sequenceid=5, compaction requested=false 2023-08-03 08:57:45,520 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72c9288c0939477ddb0a39dc699b3f24: 2023-08-03 08:57:45,520 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:57:45,520 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-03 08:57:45,520 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-03 08:57:45,520 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,520 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-03 08:57:45,520 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36381,1691053044084' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-03 08:57:45,522 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,522 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:57:45,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:57:45,523 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,523 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-03 08:57:45,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:57:45,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:57:45,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:57:45,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36381,1691053044084' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-03 08:57:45,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@215e4ec[Count = 0] remaining members to acquire global barrier 2023-08-03 08:57:45,524 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-03 08:57:45,525 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,526 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,526 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-03 08:57:45,526 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-03 08:57:45,526 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,36381,1691053044084' in zk 2023-08-03 08:57:45,526 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,526 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-03 08:57:45,529 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-03 08:57:45,529 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,529 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-03 08:57:45,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:57:45,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:57:45,529 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-03 08:57:45,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:57:45,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:57:45,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:57:45,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,36381,1691053044084': 2023-08-03 08:57:45,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36381,1691053044084' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-03 08:57:45,533 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-03 08:57:45,533 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-03 08:57:45,533 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-03 08:57:45,533 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,534 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-03 08:57:45,539 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,539 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:57:45,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:57:45,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,539 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-03 08:57:45,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:57:45,539 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-03 08:57:45,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:57:45,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:57:45,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,541 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:57:45,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,543 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,543 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,543 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-03 08:57:45,543 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,544 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-03 08:57:45,544 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:45,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-03 08:57:45,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-03 08:57:45,544 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-03 08:57:45,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-03 08:57:45,544 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:57:45,544 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,544 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:45,545 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-03 08:57:45,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-03 08:57:45,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:57:45,545 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-03 08:57:55,545 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-03 08:57:55,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-03 08:57:55,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-03 08:57:55,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-03 08:57:55,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,556 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-03 08:57:55,557 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-03 08:57:55,557 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-03 08:57:55,557 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-03 08:57:55,557 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,558 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,559 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,559 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-03 08:57:55,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-03 08:57:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:57:55,559 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,559 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-03 08:57:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-03 08:57:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,560 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,560 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-03 08:57:55,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,560 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-03 08:57:55,560 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-03 08:57:55,561 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-03 08:57:55,561 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-03 08:57:55,561 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-03 08:57:55,561 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:57:55,561 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. started... 2023-08-03 08:57:55,561 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72c9288c0939477ddb0a39dc699b3f24 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-03 08:57:55,575 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/.tmp/info/2ea176e0450244ec94147edf43878e46 2023-08-03 08:57:55,582 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/.tmp/info/2ea176e0450244ec94147edf43878e46 as hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/2ea176e0450244ec94147edf43878e46 2023-08-03 08:57:55,590 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/2ea176e0450244ec94147edf43878e46, entries=1, sequenceid=9, filesize=5.8 K 2023-08-03 08:57:55,591 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 72c9288c0939477ddb0a39dc699b3f24 in 30ms, sequenceid=9, compaction requested=false 2023-08-03 08:57:55,591 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72c9288c0939477ddb0a39dc699b3f24: 2023-08-03 08:57:55,591 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:57:55,591 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-03 08:57:55,591 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-03 08:57:55,591 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,591 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-03 08:57:55,591 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36381,1691053044084' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-03 08:57:55,593 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,593 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:57:55,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:57:55,593 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,594 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-03 08:57:55,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:57:55,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:57:55,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:57:55,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36381,1691053044084' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-03 08:57:55,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47177aca[Count = 0] remaining members to acquire global barrier 2023-08-03 08:57:55,595 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-03 08:57:55,595 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,596 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,596 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-03 08:57:55,596 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-03 08:57:55,596 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,36381,1691053044084' in zk 2023-08-03 08:57:55,596 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,596 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-03 08:57:55,599 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,599 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-03 08:57:55,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:57:55,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:57:55,599 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-03 08:57:55,600 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-03 08:57:55,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:57:55,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:57:55,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:57:55,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,36381,1691053044084': 2023-08-03 08:57:55,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36381,1691053044084' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-03 08:57:55,603 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-03 08:57:55,603 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-03 08:57:55,603 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-03 08:57:55,603 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,603 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-03 08:57:55,604 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,605 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:57:55,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:57:55,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,605 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-03 08:57:55,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:57:55,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-03 08:57:55,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:57:55,605 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:57:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,607 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:57:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,610 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,610 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,610 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-03 08:57:55,610 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-03 08:57:55,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-03 08:57:55,610 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:57:55,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-03 08:57:55,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-03 08:57:55,610 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-03 08:57:55,610 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-03 08:57:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:57:55,610 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,611 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-03 08:57:55,611 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,611 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-03 08:57:55,611 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:57:55,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-03 08:57:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:58:05,611 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-03 08:58:05,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-03 08:58:05,631 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37945,DS-64280f20-f72f-4eca-beb7-5bf889f754e6,DISK] 2023-08-03 08:58:05,632 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35719,DS-4c787860-c479-4d58-843d-7f07e2d3da32,DISK] 2023-08-03 08:58:05,635 INFO [Listener at localhost/37641] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053044487 with entries=13, filesize=6.36 KB; new WAL /user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053085615 2023-08-03 08:58:05,635 DEBUG [Listener at localhost/37641] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37945,DS-64280f20-f72f-4eca-beb7-5bf889f754e6,DISK], DatanodeInfoWithStorage[127.0.0.1:35719,DS-4c787860-c479-4d58-843d-7f07e2d3da32,DISK]] 2023-08-03 08:58:05,635 DEBUG [Listener at localhost/37641] wal.AbstractFSWAL(716): hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053044487 is not closed yet, will try archiving it next time 2023-08-03 08:58:05,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-03 08:58:05,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-03 08:58:05,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,643 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-03 08:58:05,643 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-03 08:58:05,644 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-03 08:58:05,644 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-03 08:58:05,644 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,644 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,646 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-03 08:58:05,646 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-03 08:58:05,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:58:05,646 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,646 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-03 08:58:05,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-03 08:58:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-03 08:58:05,648 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,648 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-03 08:58:05,648 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-03 08:58:05,648 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-03 08:58:05,648 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-03 08:58:05,648 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-03 08:58:05,648 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:58:05,648 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. started... 2023-08-03 08:58:05,648 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72c9288c0939477ddb0a39dc699b3f24 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-03 08:58:05,660 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=13 (bloomFilter=true), to=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/.tmp/info/4843969e4a0d49c38b1e8d3f8786b7a7 2023-08-03 08:58:05,669 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/.tmp/info/4843969e4a0d49c38b1e8d3f8786b7a7 as hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/4843969e4a0d49c38b1e8d3f8786b7a7 2023-08-03 08:58:05,676 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/4843969e4a0d49c38b1e8d3f8786b7a7, entries=1, sequenceid=13, filesize=5.8 K 2023-08-03 08:58:05,677 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 72c9288c0939477ddb0a39dc699b3f24 in 29ms, sequenceid=13, compaction requested=true 2023-08-03 08:58:05,677 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72c9288c0939477ddb0a39dc699b3f24: 2023-08-03 08:58:05,677 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:58:05,677 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-03 08:58:05,678 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-03 08:58:05,678 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,678 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-03 08:58:05,678 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36381,1691053044084' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-03 08:58:05,680 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,680 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:58:05,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:58:05,680 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,680 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-03 08:58:05,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:58:05,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:58:05,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:58:05,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36381,1691053044084' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-03 08:58:05,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23e29cdb[Count = 0] remaining members to acquire global barrier 2023-08-03 08:58:05,682 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-03 08:58:05,682 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,683 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,683 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-03 08:58:05,683 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-03 08:58:05,683 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,36381,1691053044084' in zk 2023-08-03 08:58:05,683 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,684 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-03 08:58:05,685 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-03 08:58:05,685 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,685 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-03 08:58:05,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:58:05,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:58:05,685 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-03 08:58:05,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:58:05,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:58:05,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:58:05,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,36381,1691053044084': 2023-08-03 08:58:05,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36381,1691053044084' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-03 08:58:05,688 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-03 08:58:05,688 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-03 08:58:05,688 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-03 08:58:05,688 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,688 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-03 08:58:05,690 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,690 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:58:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:58:05,690 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-03 08:58:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:58:05,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-03 08:58:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:58:05,691 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:58:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,692 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:58:05,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,695 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,695 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,695 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-03 08:58:05,695 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-03 08:58:05,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-03 08:58:05,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:58:05,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-03 08:58:05,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-03 08:58:05,695 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:05,695 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-03 08:58:05,695 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-03 08:58:05,695 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-03 08:58:05,696 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:58:05,696 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-03 08:58:05,696 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:05,696 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-03 08:58:15,696 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-03 08:58:15,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-03 08:58:15,699 DEBUG [Listener at localhost/37641] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-03 08:58:15,704 DEBUG [Listener at localhost/37641] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 17694 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-03 08:58:15,705 DEBUG [Listener at localhost/37641] regionserver.HStore(1912): 72c9288c0939477ddb0a39dc699b3f24/info is initiating minor compaction (all files) 2023-08-03 08:58:15,706 INFO [Listener at localhost/37641] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-03 08:58:15,706 INFO [Listener at localhost/37641] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:15,706 INFO [Listener at localhost/37641] regionserver.HRegion(2259): Starting compaction of 72c9288c0939477ddb0a39dc699b3f24/info in TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:58:15,706 INFO [Listener at localhost/37641] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/91936b3462b24761a5c33320482f13b0, hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/2ea176e0450244ec94147edf43878e46, hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/4843969e4a0d49c38b1e8d3f8786b7a7] into tmpdir=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/.tmp, totalSize=17.3 K 2023-08-03 08:58:15,707 DEBUG [Listener at localhost/37641] compactions.Compactor(207): Compacting 91936b3462b24761a5c33320482f13b0, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1691053065471 2023-08-03 08:58:15,707 DEBUG [Listener at localhost/37641] compactions.Compactor(207): Compacting 2ea176e0450244ec94147edf43878e46, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1691053075548 2023-08-03 08:58:15,708 DEBUG [Listener at localhost/37641] compactions.Compactor(207): Compacting 4843969e4a0d49c38b1e8d3f8786b7a7, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1691053085614 2023-08-03 08:58:15,729 INFO [Listener at localhost/37641] throttle.PressureAwareThroughputController(145): 72c9288c0939477ddb0a39dc699b3f24#info#compaction#9 average throughput is unlimited, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-03 08:58:15,747 DEBUG [Listener at localhost/37641] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/.tmp/info/e24942996a314ed789a6f2fc9dfd9fc7 as hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/e24942996a314ed789a6f2fc9dfd9fc7 2023-08-03 08:58:15,761 INFO [Listener at localhost/37641] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 72c9288c0939477ddb0a39dc699b3f24/info of 72c9288c0939477ddb0a39dc699b3f24 into e24942996a314ed789a6f2fc9dfd9fc7(size=7.9 K), total size for store is 7.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-03 08:58:15,761 DEBUG [Listener at localhost/37641] regionserver.HRegion(2289): Compaction status journal for 72c9288c0939477ddb0a39dc699b3f24: 2023-08-03 08:58:15,777 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37945,DS-64280f20-f72f-4eca-beb7-5bf889f754e6,DISK] 2023-08-03 08:58:15,778 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35719,DS-4c787860-c479-4d58-843d-7f07e2d3da32,DISK] 2023-08-03 08:58:15,780 INFO [Listener at localhost/37641] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053085615 with entries=4, filesize=2.43 KB; new WAL /user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053095763 2023-08-03 08:58:15,780 DEBUG [Listener at localhost/37641] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37945,DS-64280f20-f72f-4eca-beb7-5bf889f754e6,DISK], DatanodeInfoWithStorage[127.0.0.1:35719,DS-4c787860-c479-4d58-843d-7f07e2d3da32,DISK]] 2023-08-03 08:58:15,780 DEBUG [Listener at localhost/37641] wal.AbstractFSWAL(716): hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053085615 is not closed yet, will try archiving it next time 2023-08-03 08:58:15,781 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053044487 to hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/oldWALs/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053044487 2023-08-03 08:58:15,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-03 08:58:15,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-03 08:58:15,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,791 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-03 08:58:15,791 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-03 08:58:15,792 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-03 08:58:15,792 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-03 08:58:15,792 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,792 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,797 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,797 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-03 08:58:15,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-03 08:58:15,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:58:15,797 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,797 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-03 08:58:15,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-03 08:58:15,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,798 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,798 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-03 08:58:15,798 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,798 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-03 08:58:15,798 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-03 08:58:15,799 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-03 08:58:15,799 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-03 08:58:15,799 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-03 08:58:15,799 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:58:15,799 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. started... 2023-08-03 08:58:15,799 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72c9288c0939477ddb0a39dc699b3f24 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-03 08:58:15,813 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=18 (bloomFilter=true), to=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/.tmp/info/71d6cd683def44f8a8eb1ceada58eaf9 2023-08-03 08:58:15,820 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/.tmp/info/71d6cd683def44f8a8eb1ceada58eaf9 as hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/71d6cd683def44f8a8eb1ceada58eaf9 2023-08-03 08:58:15,826 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/71d6cd683def44f8a8eb1ceada58eaf9, entries=1, sequenceid=18, filesize=5.8 K 2023-08-03 08:58:15,827 INFO [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 72c9288c0939477ddb0a39dc699b3f24 in 28ms, sequenceid=18, compaction requested=false 2023-08-03 08:58:15,827 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72c9288c0939477ddb0a39dc699b3f24: 2023-08-03 08:58:15,827 DEBUG [rs(jenkins-hbase4.apache.org,36381,1691053044084)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:58:15,827 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-03 08:58:15,828 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-03 08:58:15,828 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,828 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-03 08:58:15,828 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36381,1691053044084' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-03 08:58:15,830 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,830 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:58:15,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:58:15,830 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,830 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-03 08:58:15,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:58:15,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:58:15,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:58:15,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36381,1691053044084' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-03 08:58:15,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@769addae[Count = 0] remaining members to acquire global barrier 2023-08-03 08:58:15,832 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-03 08:58:15,832 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,833 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,833 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-03 08:58:15,833 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-03 08:58:15,833 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,36381,1691053044084' in zk 2023-08-03 08:58:15,834 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,834 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-03 08:58:15,836 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,836 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-03 08:58:15,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:58:15,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:58:15,836 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-03 08:58:15,836 DEBUG [member: 'jenkins-hbase4.apache.org,36381,1691053044084' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-03 08:58:15,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:58:15,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:58:15,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:58:15,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,36381,1691053044084': 2023-08-03 08:58:15,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36381,1691053044084' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-03 08:58:15,839 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-03 08:58:15,840 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-03 08:58:15,840 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-03 08:58:15,840 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,840 INFO [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-03 08:58:15,841 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,841 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-03 08:58:15,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,841 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-03 08:58:15,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-03 08:58:15,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-03 08:58:15,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:58:15,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-03 08:58:15,842 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-03 08:58:15,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,844 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-03 08:58:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,846 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,846 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,846 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,846 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-03 08:58:15,846 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:15,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-03 08:58:15,847 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-03 08:58:15,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-03 08:58:15,847 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-03 08:58:15,847 DEBUG [(jenkins-hbase4.apache.org,37979,1691053044035)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-03 08:58:15,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-03 08:58:15,847 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:58:15,848 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-03 08:58:15,848 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-03 08:58:15,848 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-03 08:58:15,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-03 08:58:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:58:25,848 DEBUG [Listener at localhost/37641] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-03 08:58:25,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37979] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-03 08:58:25,868 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35719,DS-4c787860-c479-4d58-843d-7f07e2d3da32,DISK] 2023-08-03 08:58:25,868 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37945,DS-64280f20-f72f-4eca-beb7-5bf889f754e6,DISK] 2023-08-03 08:58:25,870 INFO [Listener at localhost/37641] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053095763 with entries=3, filesize=1.94 KB; new WAL /user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053105852 2023-08-03 08:58:25,870 DEBUG [Listener at localhost/37641] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35719,DS-4c787860-c479-4d58-843d-7f07e2d3da32,DISK], DatanodeInfoWithStorage[127.0.0.1:37945,DS-64280f20-f72f-4eca-beb7-5bf889f754e6,DISK]] 2023-08-03 08:58:25,870 DEBUG [Listener at localhost/37641] wal.AbstractFSWAL(716): hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053095763 is not closed yet, will try archiving it next time 2023-08-03 08:58:25,870 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-03 08:58:25,870 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/WALs/jenkins-hbase4.apache.org,36381,1691053044084/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053085615 to hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/oldWALs/jenkins-hbase4.apache.org%2C36381%2C1691053044084.1691053085615 2023-08-03 08:58:25,870 INFO [Listener at localhost/37641] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-03 08:58:25,870 DEBUG [Listener at localhost/37641] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09b3403c to 127.0.0.1:64787 2023-08-03 08:58:25,871 DEBUG [Listener at localhost/37641] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:58:25,871 DEBUG [Listener at localhost/37641] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-03 08:58:25,872 DEBUG [Listener at localhost/37641] util.JVMClusterUtil(257): Found active master hash=1158338277, stopped=false 2023-08-03 08:58:25,872 INFO [Listener at localhost/37641] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37979,1691053044035 2023-08-03 08:58:25,874 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-03 08:58:25,874 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-03 08:58:25,874 INFO [Listener at localhost/37641] procedure2.ProcedureExecutor(629): Stopping 2023-08-03 08:58:25,874 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:58:25,874 DEBUG [Listener at localhost/37641] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x466002a9 to 127.0.0.1:64787 2023-08-03 08:58:25,875 DEBUG [Listener at localhost/37641] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:58:25,875 INFO [Listener at localhost/37641] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36381,1691053044084' ***** 2023-08-03 08:58:25,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:58:25,875 INFO [Listener at localhost/37641] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-03 08:58:25,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:58:25,876 INFO [RS:0;jenkins-hbase4:36381] regionserver.HeapMemoryManager(220): Stopping 2023-08-03 08:58:25,876 INFO [RS:0;jenkins-hbase4:36381] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-03 08:58:25,876 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-03 08:58:25,876 INFO [RS:0;jenkins-hbase4:36381] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-03 08:58:25,876 INFO [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(3305): Received CLOSE for 72c9288c0939477ddb0a39dc699b3f24 2023-08-03 08:58:25,877 INFO [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(3305): Received CLOSE for d4c419c16edcf4ea6c941ac9f7d5058b 2023-08-03 08:58:25,877 INFO [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:25,877 DEBUG [RS:0;jenkins-hbase4:36381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e9339a4 to 127.0.0.1:64787 2023-08-03 08:58:25,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 72c9288c0939477ddb0a39dc699b3f24, disabling compactions & flushes 2023-08-03 08:58:25,877 DEBUG [RS:0;jenkins-hbase4:36381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:58:25,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:58:25,877 INFO [RS:0;jenkins-hbase4:36381] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-03 08:58:25,877 INFO [RS:0;jenkins-hbase4:36381] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-03 08:58:25,877 INFO [RS:0;jenkins-hbase4:36381] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-03 08:58:25,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:58:25,877 INFO [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-03 08:58:25,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. after waiting 0 ms 2023-08-03 08:58:25,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:58:25,877 INFO [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-08-03 08:58:25,877 DEBUG [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(1478): Online Regions={72c9288c0939477ddb0a39dc699b3f24=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24., 1588230740=hbase:meta,,1.1588230740, d4c419c16edcf4ea6c941ac9f7d5058b=hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b.} 2023-08-03 08:58:25,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 72c9288c0939477ddb0a39dc699b3f24 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-03 08:58:25,878 DEBUG [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(1504): Waiting on 1588230740, 72c9288c0939477ddb0a39dc699b3f24, d4c419c16edcf4ea6c941ac9f7d5058b 2023-08-03 08:58:25,878 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-03 08:58:25,878 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-03 08:58:25,878 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-03 08:58:25,878 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-03 08:58:25,878 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-03 08:58:25,878 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.10 KB heapSize=5.61 KB 2023-08-03 08:58:25,902 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.84 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/.tmp/info/724039aa42664efdb0c42960609b7ec0 2023-08-03 08:58:25,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=22 (bloomFilter=true), to=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/.tmp/info/95cb59cfc2a54c4681be83a0f397d95f 2023-08-03 08:58:25,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/.tmp/info/95cb59cfc2a54c4681be83a0f397d95f as hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/95cb59cfc2a54c4681be83a0f397d95f 2023-08-03 08:58:25,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/95cb59cfc2a54c4681be83a0f397d95f, entries=1, sequenceid=22, filesize=5.8 K 2023-08-03 08:58:25,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 72c9288c0939477ddb0a39dc699b3f24 in 47ms, sequenceid=22, compaction requested=true 2023-08-03 08:58:25,929 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/91936b3462b24761a5c33320482f13b0, hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/2ea176e0450244ec94147edf43878e46, hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/4843969e4a0d49c38b1e8d3f8786b7a7] to archive 2023-08-03 08:58:25,931 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-03 08:58:25,935 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=264 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/.tmp/table/fa88c466b27544e0b3c9a33d5a2748cc 2023-08-03 08:58:25,936 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/91936b3462b24761a5c33320482f13b0 to hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/91936b3462b24761a5c33320482f13b0 2023-08-03 08:58:25,938 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/2ea176e0450244ec94147edf43878e46 to hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/2ea176e0450244ec94147edf43878e46 2023-08-03 08:58:25,941 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/4843969e4a0d49c38b1e8d3f8786b7a7 to hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/info/4843969e4a0d49c38b1e8d3f8786b7a7 2023-08-03 08:58:25,943 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/.tmp/info/724039aa42664efdb0c42960609b7ec0 as hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/info/724039aa42664efdb0c42960609b7ec0 2023-08-03 08:58:25,950 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/info/724039aa42664efdb0c42960609b7ec0, entries=20, sequenceid=14, filesize=7.6 K 2023-08-03 08:58:25,951 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/.tmp/table/fa88c466b27544e0b3c9a33d5a2748cc as hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/table/fa88c466b27544e0b3c9a33d5a2748cc 2023-08-03 08:58:25,958 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/table/fa88c466b27544e0b3c9a33d5a2748cc, entries=4, sequenceid=14, filesize=4.9 K 2023-08-03 08:58:25,960 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.10 KB/3174, heapSize ~5.33 KB/5456, currentSize=0 B/0 for 1588230740 in 82ms, sequenceid=14, compaction requested=false 2023-08-03 08:58:25,967 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-08-03 08:58:25,968 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-03 08:58:25,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-03 08:58:25,969 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-03 08:58:25,969 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-03 08:58:25,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/72c9288c0939477ddb0a39dc699b3f24/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2023-08-03 08:58:25,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:58:25,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 72c9288c0939477ddb0a39dc699b3f24: 2023-08-03 08:58:25,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691053045356.72c9288c0939477ddb0a39dc699b3f24. 2023-08-03 08:58:25,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d4c419c16edcf4ea6c941ac9f7d5058b, disabling compactions & flushes 2023-08-03 08:58:25,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:58:25,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:58:25,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. after waiting 0 ms 2023-08-03 08:58:25,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:58:25,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/data/hbase/namespace/d4c419c16edcf4ea6c941ac9f7d5058b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-03 08:58:25,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:58:25,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d4c419c16edcf4ea6c941ac9f7d5058b: 2023-08-03 08:58:25,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1691053044719.d4c419c16edcf4ea6c941ac9f7d5058b. 2023-08-03 08:58:26,078 INFO [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36381,1691053044084; all regions closed. 2023-08-03 08:58:26,084 DEBUG [RS:0;jenkins-hbase4:36381] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/oldWALs 2023-08-03 08:58:26,084 INFO [RS:0;jenkins-hbase4:36381] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36381%2C1691053044084.meta:.meta(num 1691053044650) 2023-08-03 08:58:26,090 DEBUG [RS:0;jenkins-hbase4:36381] wal.AbstractFSWAL(1028): Moved 2 WAL file(s) to /user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/oldWALs 2023-08-03 08:58:26,090 INFO [RS:0;jenkins-hbase4:36381] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36381%2C1691053044084:(num 1691053105852) 2023-08-03 08:58:26,090 DEBUG [RS:0;jenkins-hbase4:36381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:58:26,090 INFO [RS:0;jenkins-hbase4:36381] regionserver.LeaseManager(133): Closed leases 2023-08-03 08:58:26,090 INFO [RS:0;jenkins-hbase4:36381] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-03 08:58:26,090 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-03 08:58:26,091 INFO [RS:0;jenkins-hbase4:36381] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36381 2023-08-03 08:58:26,094 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36381,1691053044084 2023-08-03 08:58:26,094 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-03 08:58:26,094 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-03 08:58:26,096 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36381,1691053044084] 2023-08-03 08:58:26,096 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36381,1691053044084; numProcessing=1 2023-08-03 08:58:26,097 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36381,1691053044084 already deleted, retry=false 2023-08-03 08:58:26,097 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36381,1691053044084 expired; onlineServers=0 2023-08-03 08:58:26,097 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37979,1691053044035' ***** 2023-08-03 08:58:26,097 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-03 08:58:26,097 DEBUG [M:0;jenkins-hbase4:37979] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41354a9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-03 08:58:26,097 INFO [M:0;jenkins-hbase4:37979] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37979,1691053044035 2023-08-03 08:58:26,098 INFO [M:0;jenkins-hbase4:37979] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37979,1691053044035; all regions closed. 2023-08-03 08:58:26,098 DEBUG [M:0;jenkins-hbase4:37979] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:58:26,098 DEBUG [M:0;jenkins-hbase4:37979] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-03 08:58:26,098 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-03 08:58:26,098 DEBUG [M:0;jenkins-hbase4:37979] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-03 08:58:26,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691053044263] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691053044263,5,FailOnTimeoutGroup] 2023-08-03 08:58:26,098 INFO [M:0;jenkins-hbase4:37979] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-03 08:58:26,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691053044263] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691053044263,5,FailOnTimeoutGroup] 2023-08-03 08:58:26,098 INFO [M:0;jenkins-hbase4:37979] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-03 08:58:26,099 INFO [M:0;jenkins-hbase4:37979] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-03 08:58:26,099 DEBUG [M:0;jenkins-hbase4:37979] master.HMaster(1512): Stopping service threads 2023-08-03 08:58:26,099 INFO [M:0;jenkins-hbase4:37979] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-03 08:58:26,099 ERROR [M:0;jenkins-hbase4:37979] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-08-03 08:58:26,099 INFO [M:0;jenkins-hbase4:37979] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-03 08:58:26,099 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-03 08:58:26,099 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-03 08:58:26,099 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:58:26,100 DEBUG [M:0;jenkins-hbase4:37979] zookeeper.ZKUtil(398): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-03 08:58:26,100 WARN [M:0;jenkins-hbase4:37979] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-03 08:58:26,100 INFO [M:0;jenkins-hbase4:37979] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-03 08:58:26,100 INFO [M:0;jenkins-hbase4:37979] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-03 08:58:26,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-03 08:58:26,100 DEBUG [M:0;jenkins-hbase4:37979] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-03 08:58:26,100 INFO [M:0;jenkins-hbase4:37979] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:58:26,100 DEBUG [M:0;jenkins-hbase4:37979] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:58:26,101 DEBUG [M:0;jenkins-hbase4:37979] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-03 08:58:26,101 DEBUG [M:0;jenkins-hbase4:37979] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:58:26,101 INFO [M:0;jenkins-hbase4:37979] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.90 KB heapSize=47.33 KB 2023-08-03 08:58:26,114 INFO [M:0;jenkins-hbase4:37979] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.90 KB at sequenceid=100 (bloomFilter=true), to=hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8a123928519549d594242df4c0441af0 2023-08-03 08:58:26,119 INFO [M:0;jenkins-hbase4:37979] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8a123928519549d594242df4c0441af0 2023-08-03 08:58:26,120 DEBUG [M:0;jenkins-hbase4:37979] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8a123928519549d594242df4c0441af0 as hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8a123928519549d594242df4c0441af0 2023-08-03 08:58:26,126 INFO [M:0;jenkins-hbase4:37979] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8a123928519549d594242df4c0441af0 2023-08-03 08:58:26,126 INFO [M:0;jenkins-hbase4:37979] regionserver.HStore(1080): Added hdfs://localhost:36709/user/jenkins/test-data/d064103d-f8c0-aff6-f307-78d8bacc8e54/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8a123928519549d594242df4c0441af0, entries=11, sequenceid=100, filesize=6.1 K 2023-08-03 08:58:26,127 INFO [M:0;jenkins-hbase4:37979] regionserver.HRegion(2948): Finished flush of dataSize ~38.90 KB/39836, heapSize ~47.31 KB/48448, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=100, compaction requested=false 2023-08-03 08:58:26,128 INFO [M:0;jenkins-hbase4:37979] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:58:26,129 DEBUG [M:0;jenkins-hbase4:37979] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-03 08:58:26,132 INFO [M:0;jenkins-hbase4:37979] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-03 08:58:26,132 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-03 08:58:26,132 INFO [M:0;jenkins-hbase4:37979] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37979 2023-08-03 08:58:26,134 DEBUG [M:0;jenkins-hbase4:37979] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37979,1691053044035 already deleted, retry=false 2023-08-03 08:58:26,196 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:58:26,196 INFO [RS:0;jenkins-hbase4:36381] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36381,1691053044084; zookeeper connection closed. 2023-08-03 08:58:26,196 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): regionserver:36381-0x101ca0c34300001, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:58:26,197 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@520848b7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@520848b7 2023-08-03 08:58:26,197 INFO [Listener at localhost/37641] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-03 08:58:26,296 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:58:26,296 INFO [M:0;jenkins-hbase4:37979] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37979,1691053044035; zookeeper connection closed. 2023-08-03 08:58:26,296 DEBUG [Listener at localhost/37641-EventThread] zookeeper.ZKWatcher(600): master:37979-0x101ca0c34300000, quorum=127.0.0.1:64787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:58:26,297 WARN [Listener at localhost/37641] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-03 08:58:26,300 INFO [Listener at localhost/37641] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:58:26,358 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-03 08:58:26,405 WARN [BP-1591665959-172.31.14.131-1691053043451 heartbeating to localhost/127.0.0.1:36709] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-03 08:58:26,405 WARN [BP-1591665959-172.31.14.131-1691053043451 heartbeating to localhost/127.0.0.1:36709] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1591665959-172.31.14.131-1691053043451 (Datanode Uuid 68f81bd4-e423-437b-b625-c32a331869ae) service to localhost/127.0.0.1:36709 2023-08-03 08:58:26,406 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/cluster_f9b0a787-a45a-52dc-46c8-206911ed99fd/dfs/data/data3/current/BP-1591665959-172.31.14.131-1691053043451] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:58:26,406 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/cluster_f9b0a787-a45a-52dc-46c8-206911ed99fd/dfs/data/data4/current/BP-1591665959-172.31.14.131-1691053043451] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:58:26,407 WARN [Listener at localhost/37641] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-03 08:58:26,410 INFO [Listener at localhost/37641] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:58:26,513 WARN [BP-1591665959-172.31.14.131-1691053043451 heartbeating to localhost/127.0.0.1:36709] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-03 08:58:26,513 WARN [BP-1591665959-172.31.14.131-1691053043451 heartbeating to localhost/127.0.0.1:36709] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1591665959-172.31.14.131-1691053043451 (Datanode Uuid 784fb68c-d067-4b6c-aecc-03029d9e7b75) service to localhost/127.0.0.1:36709 2023-08-03 08:58:26,514 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/cluster_f9b0a787-a45a-52dc-46c8-206911ed99fd/dfs/data/data1/current/BP-1591665959-172.31.14.131-1691053043451] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:58:26,515 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/cluster_f9b0a787-a45a-52dc-46c8-206911ed99fd/dfs/data/data2/current/BP-1591665959-172.31.14.131-1691053043451] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:58:26,526 INFO [Listener at localhost/37641] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:58:26,639 INFO [Listener at localhost/37641] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-03 08:58:26,659 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-03 08:58:26,671 INFO [Listener at localhost/37641] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=63 (was 77), OpenFileDescriptor=442 (was 470), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=82 (was 177), ProcessCount=176 (was 176), AvailableMemoryMB=977 (was 1191) 2023-08-03 08:58:26,683 INFO [Listener at localhost/37641] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=64, OpenFileDescriptor=442, MaxFileDescriptor=60000, SystemLoadAverage=82, ProcessCount=176, AvailableMemoryMB=977 2023-08-03 08:58:26,684 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-03 08:58:26,684 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/hadoop.log.dir so I do NOT create it in target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713 2023-08-03 08:58:26,684 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9631c665-fcd5-294f-5657-8c952d13acdb/hadoop.tmp.dir so I do NOT create it in target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713 2023-08-03 08:58:26,684 INFO [Listener at localhost/37641] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/cluster_d03f793a-8007-d2fd-107a-eeef7c4fbe9e, deleteOnExit=true 2023-08-03 08:58:26,684 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-03 08:58:26,685 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/test.cache.data in system properties and HBase conf 2023-08-03 08:58:26,685 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/hadoop.tmp.dir in system properties and HBase conf 2023-08-03 08:58:26,685 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/hadoop.log.dir in system properties and HBase conf 2023-08-03 08:58:26,685 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-03 08:58:26,685 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-03 08:58:26,685 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-03 08:58:26,686 DEBUG [Listener at localhost/37641] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-03 08:58:26,686 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-03 08:58:26,686 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-03 08:58:26,687 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-03 08:58:26,687 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-03 08:58:26,687 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-03 08:58:26,687 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-03 08:58:26,687 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-03 08:58:26,687 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-03 08:58:26,688 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-03 08:58:26,688 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/nfs.dump.dir in system properties and HBase conf 2023-08-03 08:58:26,688 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/java.io.tmpdir in system properties and HBase conf 2023-08-03 08:58:26,688 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-03 08:58:26,688 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-03 08:58:26,688 INFO [Listener at localhost/37641] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-03 08:58:26,692 WARN [Listener at localhost/37641] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-03 08:58:26,692 WARN [Listener at localhost/37641] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-03 08:58:26,759 WARN [Listener at localhost/37641] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:58:26,762 INFO [Listener at localhost/37641] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:58:26,798 INFO [Listener at localhost/37641] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/java.io.tmpdir/Jetty_localhost_32983_hdfs____pout3z/webapp 2023-08-03 08:58:26,917 INFO [Listener at localhost/37641] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32983 2023-08-03 08:58:26,922 WARN [Listener at localhost/37641] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-03 08:58:26,922 WARN [Listener at localhost/37641] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-03 08:58:26,994 WARN [Listener at localhost/37021] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:58:27,011 WARN [Listener at localhost/37021] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-03 08:58:27,014 WARN [Listener at localhost/37021] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:58:27,017 INFO [Listener at localhost/37021] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:58:27,024 INFO [Listener at localhost/37021] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/java.io.tmpdir/Jetty_localhost_45633_datanode____9uf598/webapp 2023-08-03 08:58:27,132 INFO [Listener at localhost/37021] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45633 2023-08-03 08:58:27,142 WARN [Listener at localhost/41009] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:58:27,158 WARN [Listener at localhost/41009] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-03 08:58:27,160 WARN [Listener at localhost/41009] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:58:27,161 INFO [Listener at localhost/41009] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:58:27,166 INFO [Listener at localhost/41009] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/java.io.tmpdir/Jetty_localhost_35977_datanode____9en53y/webapp 2023-08-03 08:58:27,269 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdc21e76dccd625ae: Processing first storage report for DS-c8c52b92-99f1-4b03-a5db-5a77ae4f2bbe from datanode 93c24eb0-55b1-4c39-bcf5-38fb5e42125c 2023-08-03 08:58:27,269 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdc21e76dccd625ae: from storage DS-c8c52b92-99f1-4b03-a5db-5a77ae4f2bbe node DatanodeRegistration(127.0.0.1:41265, datanodeUuid=93c24eb0-55b1-4c39-bcf5-38fb5e42125c, infoPort=46831, infoSecurePort=0, ipcPort=41009, storageInfo=lv=-57;cid=testClusterID;nsid=1658255572;c=1691053106695), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:58:27,270 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdc21e76dccd625ae: Processing first storage report for DS-206953d6-dfd6-4d08-8020-77d1d8776880 from datanode 93c24eb0-55b1-4c39-bcf5-38fb5e42125c 2023-08-03 08:58:27,270 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdc21e76dccd625ae: from storage DS-206953d6-dfd6-4d08-8020-77d1d8776880 node DatanodeRegistration(127.0.0.1:41265, datanodeUuid=93c24eb0-55b1-4c39-bcf5-38fb5e42125c, infoPort=46831, infoSecurePort=0, ipcPort=41009, storageInfo=lv=-57;cid=testClusterID;nsid=1658255572;c=1691053106695), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:58:27,293 INFO [Listener at localhost/41009] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35977 2023-08-03 08:58:27,302 WARN [Listener at localhost/37831] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:58:27,394 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa5f822f4cd8e8f0: Processing first storage report for DS-b4ef9096-3416-4fdc-ac73-8952e5832454 from datanode 29e0ced5-6ba0-481a-8e26-b39ed2be4810 2023-08-03 08:58:27,394 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa5f822f4cd8e8f0: from storage DS-b4ef9096-3416-4fdc-ac73-8952e5832454 node DatanodeRegistration(127.0.0.1:45737, datanodeUuid=29e0ced5-6ba0-481a-8e26-b39ed2be4810, infoPort=43663, infoSecurePort=0, ipcPort=37831, storageInfo=lv=-57;cid=testClusterID;nsid=1658255572;c=1691053106695), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-03 08:58:27,395 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa5f822f4cd8e8f0: Processing first storage report for DS-77ae4d08-ee38-475c-9e1a-2471ac4f842c from datanode 29e0ced5-6ba0-481a-8e26-b39ed2be4810 2023-08-03 08:58:27,395 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa5f822f4cd8e8f0: from storage DS-77ae4d08-ee38-475c-9e1a-2471ac4f842c node DatanodeRegistration(127.0.0.1:45737, datanodeUuid=29e0ced5-6ba0-481a-8e26-b39ed2be4810, infoPort=43663, infoSecurePort=0, ipcPort=37831, storageInfo=lv=-57;cid=testClusterID;nsid=1658255572;c=1691053106695), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:58:27,414 DEBUG [Listener at localhost/37831] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713 2023-08-03 08:58:27,417 INFO [Listener at localhost/37831] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/cluster_d03f793a-8007-d2fd-107a-eeef7c4fbe9e/zookeeper_0, clientPort=57170, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/cluster_d03f793a-8007-d2fd-107a-eeef7c4fbe9e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/cluster_d03f793a-8007-d2fd-107a-eeef7c4fbe9e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-03 08:58:27,418 INFO [Listener at localhost/37831] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57170 2023-08-03 08:58:27,418 INFO [Listener at localhost/37831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:58:27,419 INFO [Listener at localhost/37831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:58:27,432 INFO [Listener at localhost/37831] util.FSUtils(471): Created version file at hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c with version=8 2023-08-03 08:58:27,432 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/hbase-staging 2023-08-03 08:58:27,434 INFO [Listener at localhost/37831] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-03 08:58:27,434 INFO [Listener at localhost/37831] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:58:27,434 INFO [Listener at localhost/37831] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-03 08:58:27,435 INFO [Listener at localhost/37831] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-03 08:58:27,435 INFO [Listener at localhost/37831] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:58:27,435 INFO [Listener at localhost/37831] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-03 08:58:27,435 INFO [Listener at localhost/37831] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-03 08:58:27,436 INFO [Listener at localhost/37831] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36663 2023-08-03 08:58:27,436 INFO [Listener at localhost/37831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:58:27,437 INFO [Listener at localhost/37831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:58:27,438 INFO [Listener at localhost/37831] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36663 connecting to ZooKeeper ensemble=127.0.0.1:57170 2023-08-03 08:58:27,444 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:366630x0, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-03 08:58:27,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36663-0x101ca0d2bdb0000 connected 2023-08-03 08:58:27,460 DEBUG [Listener at localhost/37831] zookeeper.ZKUtil(164): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-03 08:58:27,460 DEBUG [Listener at localhost/37831] zookeeper.ZKUtil(164): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:58:27,460 DEBUG [Listener at localhost/37831] zookeeper.ZKUtil(164): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-03 08:58:27,461 DEBUG [Listener at localhost/37831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36663 2023-08-03 08:58:27,461 DEBUG [Listener at localhost/37831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36663 2023-08-03 08:58:27,461 DEBUG [Listener at localhost/37831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36663 2023-08-03 08:58:27,461 DEBUG [Listener at localhost/37831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36663 2023-08-03 08:58:27,462 DEBUG [Listener at localhost/37831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36663 2023-08-03 08:58:27,462 INFO [Listener at localhost/37831] master.HMaster(444): hbase.rootdir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c, hbase.cluster.distributed=false 2023-08-03 08:58:27,479 INFO [Listener at localhost/37831] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-03 08:58:27,479 INFO [Listener at localhost/37831] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:58:27,479 INFO [Listener at localhost/37831] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-03 08:58:27,479 INFO [Listener at localhost/37831] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-03 08:58:27,479 INFO [Listener at localhost/37831] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:58:27,479 INFO [Listener at localhost/37831] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-03 08:58:27,479 INFO [Listener at localhost/37831] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-03 08:58:27,481 INFO [Listener at localhost/37831] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45367 2023-08-03 08:58:27,482 INFO [Listener at localhost/37831] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-03 08:58:27,485 DEBUG [Listener at localhost/37831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-03 08:58:27,486 INFO [Listener at localhost/37831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:58:27,487 INFO [Listener at localhost/37831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:58:27,489 INFO [Listener at localhost/37831] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45367 connecting to ZooKeeper ensemble=127.0.0.1:57170 2023-08-03 08:58:27,494 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): regionserver:453670x0, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-03 08:58:27,495 DEBUG [Listener at localhost/37831] zookeeper.ZKUtil(164): regionserver:453670x0, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-03 08:58:27,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45367-0x101ca0d2bdb0001 connected 2023-08-03 08:58:27,501 DEBUG [Listener at localhost/37831] zookeeper.ZKUtil(164): regionserver:45367-0x101ca0d2bdb0001, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:58:27,501 DEBUG [Listener at localhost/37831] zookeeper.ZKUtil(164): regionserver:45367-0x101ca0d2bdb0001, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-03 08:58:27,507 DEBUG [Listener at localhost/37831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45367 2023-08-03 08:58:27,507 DEBUG [Listener at localhost/37831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45367 2023-08-03 08:58:27,507 DEBUG [Listener at localhost/37831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45367 2023-08-03 08:58:27,509 DEBUG [Listener at localhost/37831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45367 2023-08-03 08:58:27,509 DEBUG [Listener at localhost/37831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45367 2023-08-03 08:58:27,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36663,1691053107434 2023-08-03 08:58:27,514 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-03 08:58:27,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36663,1691053107434 2023-08-03 08:58:27,516 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-03 08:58:27,516 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): regionserver:45367-0x101ca0d2bdb0001, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-03 08:58:27,516 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:58:27,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-03 08:58:27,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36663,1691053107434 from backup master directory 2023-08-03 08:58:27,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-03 08:58:27,519 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36663,1691053107434 2023-08-03 08:58:27,519 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-03 08:58:27,519 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-03 08:58:27,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36663,1691053107434 2023-08-03 08:58:27,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/hbase.id with ID: fe2a56bf-ac96-4ec3-b3fc-be6855b6ea10 2023-08-03 08:58:27,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:58:27,559 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:58:27,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7f426bc1 to 127.0.0.1:57170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-03 08:58:27,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fd100a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-03 08:58:27,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-03 08:58:27,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-03 08:58:27,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:58:27,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/data/master/store-tmp 2023-08-03 08:58:27,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:58:27,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-03 08:58:27,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:58:27,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:58:27,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-03 08:58:27,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:58:27,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:58:27,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-03 08:58:27,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/WALs/jenkins-hbase4.apache.org,36663,1691053107434 2023-08-03 08:58:27,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36663%2C1691053107434, suffix=, logDir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/WALs/jenkins-hbase4.apache.org,36663,1691053107434, archiveDir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/oldWALs, maxLogs=10 2023-08-03 08:58:27,630 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45737,DS-b4ef9096-3416-4fdc-ac73-8952e5832454,DISK] 2023-08-03 08:58:27,630 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41265,DS-c8c52b92-99f1-4b03-a5db-5a77ae4f2bbe,DISK] 2023-08-03 08:58:27,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/WALs/jenkins-hbase4.apache.org,36663,1691053107434/jenkins-hbase4.apache.org%2C36663%2C1691053107434.1691053107608 2023-08-03 08:58:27,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45737,DS-b4ef9096-3416-4fdc-ac73-8952e5832454,DISK], DatanodeInfoWithStorage[127.0.0.1:41265,DS-c8c52b92-99f1-4b03-a5db-5a77ae4f2bbe,DISK]] 2023-08-03 08:58:27,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:58:27,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:58:27,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:58:27,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:58:27,639 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:58:27,641 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-03 08:58:27,641 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-03 08:58:27,642 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:58:27,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:58:27,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:58:27,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:58:27,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:58:27,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=794665, jitterRate=0.010469421744346619}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:58:27,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-03 08:58:27,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-03 08:58:27,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-03 08:58:27,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-03 08:58:27,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-03 08:58:27,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-03 08:58:27,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-03 08:58:27,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-03 08:58:27,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-03 08:58:27,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-03 08:58:27,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-03 08:58:27,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-03 08:58:27,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-03 08:58:27,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-03 08:58:27,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-03 08:58:27,673 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:58:27,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-03 08:58:27,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-03 08:58:27,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-03 08:58:27,676 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-03 08:58:27,676 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): regionserver:45367-0x101ca0d2bdb0001, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-03 08:58:27,676 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:58:27,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36663,1691053107434, sessionid=0x101ca0d2bdb0000, setting cluster-up flag (Was=false) 2023-08-03 08:58:27,681 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:58:27,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-03 08:58:27,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36663,1691053107434 2023-08-03 08:58:27,690 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:58:27,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-03 08:58:27,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36663,1691053107434 2023-08-03 08:58:27,697 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/.hbase-snapshot/.tmp 2023-08-03 08:58:27,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-03 08:58:27,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:58:27,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:58:27,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:58:27,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:58:27,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-03 08:58:27,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:58:27,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-03 08:58:27,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:58:27,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1691053137715 2023-08-03 08:58:27,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-03 08:58:27,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-03 08:58:27,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-03 08:58:27,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-03 08:58:27,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-03 08:58:27,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-03 08:58:27,716 INFO [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(951): ClusterId : fe2a56bf-ac96-4ec3-b3fc-be6855b6ea10 2023-08-03 08:58:27,716 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-03 08:58:27,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:27,717 DEBUG [RS:0;jenkins-hbase4:45367] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-03 08:58:27,718 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-03 08:58:27,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-03 08:58:27,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-03 08:58:27,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-03 08:58:27,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-03 08:58:27,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-03 08:58:27,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691053107719,5,FailOnTimeoutGroup] 2023-08-03 08:58:27,720 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-03 08:58:27,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691053107719,5,FailOnTimeoutGroup] 2023-08-03 08:58:27,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:27,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-03 08:58:27,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:27,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:27,724 DEBUG [RS:0;jenkins-hbase4:45367] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-03 08:58:27,726 DEBUG [RS:0;jenkins-hbase4:45367] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-03 08:58:27,729 DEBUG [RS:0;jenkins-hbase4:45367] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-03 08:58:27,732 DEBUG [RS:0;jenkins-hbase4:45367] zookeeper.ReadOnlyZKClient(139): Connect 0x18bf9318 to 127.0.0.1:57170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-03 08:58:27,738 DEBUG [RS:0;jenkins-hbase4:45367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16787e7f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-03 08:58:27,738 DEBUG [RS:0;jenkins-hbase4:45367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1247f868, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-03 08:58:27,739 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-03 08:58:27,739 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-03 08:58:27,740 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c 2023-08-03 08:58:27,750 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:58:27,751 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-03 08:58:27,752 DEBUG [RS:0;jenkins-hbase4:45367] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45367 2023-08-03 08:58:27,752 INFO [RS:0;jenkins-hbase4:45367] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-03 08:58:27,752 INFO [RS:0;jenkins-hbase4:45367] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-03 08:58:27,752 DEBUG [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(1022): About to register with Master. 2023-08-03 08:58:27,753 INFO [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36663,1691053107434 with isa=jenkins-hbase4.apache.org/172.31.14.131:45367, startcode=1691053107478 2023-08-03 08:58:27,753 DEBUG [RS:0;jenkins-hbase4:45367] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-03 08:58:27,753 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/info 2023-08-03 08:58:27,754 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-03 08:58:27,755 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:58:27,755 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-03 08:58:27,755 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44771, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-08-03 08:58:27,757 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36663] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:27,757 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/rep_barrier 2023-08-03 08:58:27,757 DEBUG [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c 2023-08-03 08:58:27,757 DEBUG [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37021 2023-08-03 08:58:27,757 DEBUG [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-03 08:58:27,757 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-03 08:58:27,758 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:58:27,758 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-03 08:58:27,759 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-03 08:58:27,760 DEBUG [RS:0;jenkins-hbase4:45367] zookeeper.ZKUtil(162): regionserver:45367-0x101ca0d2bdb0001, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:27,760 WARN [RS:0;jenkins-hbase4:45367] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-03 08:58:27,760 INFO [RS:0;jenkins-hbase4:45367] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:58:27,760 DEBUG [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:27,760 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45367,1691053107478] 2023-08-03 08:58:27,760 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/table 2023-08-03 08:58:27,760 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-03 08:58:27,762 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:58:27,763 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740 2023-08-03 08:58:27,763 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740 2023-08-03 08:58:27,764 DEBUG [RS:0;jenkins-hbase4:45367] zookeeper.ZKUtil(162): regionserver:45367-0x101ca0d2bdb0001, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:27,765 DEBUG [RS:0;jenkins-hbase4:45367] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-03 08:58:27,765 INFO [RS:0;jenkins-hbase4:45367] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-03 08:58:27,766 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-03 08:58:27,766 INFO [RS:0;jenkins-hbase4:45367] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-03 08:58:27,767 INFO [RS:0;jenkins-hbase4:45367] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-03 08:58:27,767 INFO [RS:0;jenkins-hbase4:45367] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:27,767 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-03 08:58:27,770 INFO [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-03 08:58:27,772 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:58:27,772 INFO [RS:0;jenkins-hbase4:45367] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:27,773 DEBUG [RS:0;jenkins-hbase4:45367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:58:27,773 DEBUG [RS:0;jenkins-hbase4:45367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:58:27,773 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=821206, jitterRate=0.044218048453330994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-03 08:58:27,773 DEBUG [RS:0;jenkins-hbase4:45367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:58:27,773 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-03 08:58:27,773 DEBUG [RS:0;jenkins-hbase4:45367] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:58:27,773 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-03 08:58:27,773 DEBUG [RS:0;jenkins-hbase4:45367] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:58:27,773 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-03 08:58:27,773 DEBUG [RS:0;jenkins-hbase4:45367] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-03 08:58:27,773 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-03 08:58:27,773 DEBUG [RS:0;jenkins-hbase4:45367] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:58:27,773 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-03 08:58:27,773 DEBUG [RS:0;jenkins-hbase4:45367] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:58:27,773 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-03 08:58:27,774 DEBUG [RS:0;jenkins-hbase4:45367] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:58:27,774 DEBUG [RS:0;jenkins-hbase4:45367] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:58:27,774 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-03 08:58:27,774 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-03 08:58:27,775 INFO [RS:0;jenkins-hbase4:45367] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:27,775 INFO [RS:0;jenkins-hbase4:45367] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:27,775 INFO [RS:0;jenkins-hbase4:45367] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:27,775 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-03 08:58:27,776 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-03 08:58:27,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-03 08:58:27,777 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-03 08:58:27,779 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-03 08:58:27,788 INFO [RS:0;jenkins-hbase4:45367] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-03 08:58:27,788 INFO [RS:0;jenkins-hbase4:45367] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45367,1691053107478-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:27,798 INFO [RS:0;jenkins-hbase4:45367] regionserver.Replication(203): jenkins-hbase4.apache.org,45367,1691053107478 started 2023-08-03 08:58:27,798 INFO [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45367,1691053107478, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45367, sessionid=0x101ca0d2bdb0001 2023-08-03 08:58:27,798 DEBUG [RS:0;jenkins-hbase4:45367] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-03 08:58:27,798 DEBUG [RS:0;jenkins-hbase4:45367] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:27,798 DEBUG [RS:0;jenkins-hbase4:45367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45367,1691053107478' 2023-08-03 08:58:27,798 DEBUG [RS:0;jenkins-hbase4:45367] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:58:27,799 DEBUG [RS:0;jenkins-hbase4:45367] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:58:27,799 DEBUG [RS:0;jenkins-hbase4:45367] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-03 08:58:27,799 DEBUG [RS:0;jenkins-hbase4:45367] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-03 08:58:27,799 DEBUG [RS:0;jenkins-hbase4:45367] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:27,799 DEBUG [RS:0;jenkins-hbase4:45367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45367,1691053107478' 2023-08-03 08:58:27,799 DEBUG [RS:0;jenkins-hbase4:45367] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-03 08:58:27,800 DEBUG [RS:0;jenkins-hbase4:45367] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-03 08:58:27,800 DEBUG [RS:0;jenkins-hbase4:45367] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-03 08:58:27,800 INFO [RS:0;jenkins-hbase4:45367] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-03 08:58:27,800 INFO [RS:0;jenkins-hbase4:45367] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-03 08:58:27,903 INFO [RS:0;jenkins-hbase4:45367] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45367%2C1691053107478, suffix=, logDir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478, archiveDir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/oldWALs, maxLogs=32 2023-08-03 08:58:27,919 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45737,DS-b4ef9096-3416-4fdc-ac73-8952e5832454,DISK] 2023-08-03 08:58:27,919 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41265,DS-c8c52b92-99f1-4b03-a5db-5a77ae4f2bbe,DISK] 2023-08-03 08:58:27,921 INFO [RS:0;jenkins-hbase4:45367] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053107903 2023-08-03 08:58:27,921 DEBUG [RS:0;jenkins-hbase4:45367] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45737,DS-b4ef9096-3416-4fdc-ac73-8952e5832454,DISK], DatanodeInfoWithStorage[127.0.0.1:41265,DS-c8c52b92-99f1-4b03-a5db-5a77ae4f2bbe,DISK]] 2023-08-03 08:58:27,929 DEBUG [jenkins-hbase4:36663] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-03 08:58:27,929 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45367,1691053107478, state=OPENING 2023-08-03 08:58:27,931 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-03 08:58:27,932 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:58:27,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45367,1691053107478}] 2023-08-03 08:58:27,932 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-03 08:58:28,086 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:28,086 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-03 08:58:28,088 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-03 08:58:28,092 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-03 08:58:28,093 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:58:28,094 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45367%2C1691053107478.meta, suffix=.meta, logDir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478, archiveDir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/oldWALs, maxLogs=32 2023-08-03 08:58:28,109 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45737,DS-b4ef9096-3416-4fdc-ac73-8952e5832454,DISK] 2023-08-03 08:58:28,109 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41265,DS-c8c52b92-99f1-4b03-a5db-5a77ae4f2bbe,DISK] 2023-08-03 08:58:28,111 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.meta.1691053108095.meta 2023-08-03 08:58:28,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45737,DS-b4ef9096-3416-4fdc-ac73-8952e5832454,DISK], DatanodeInfoWithStorage[127.0.0.1:41265,DS-c8c52b92-99f1-4b03-a5db-5a77ae4f2bbe,DISK]] 2023-08-03 08:58:28,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:58:28,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-03 08:58:28,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-03 08:58:28,112 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-03 08:58:28,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-03 08:58:28,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:58:28,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-03 08:58:28,113 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-03 08:58:28,114 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-03 08:58:28,116 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/info 2023-08-03 08:58:28,116 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/info 2023-08-03 08:58:28,116 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-03 08:58:28,117 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:58:28,117 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-03 08:58:28,118 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/rep_barrier 2023-08-03 08:58:28,118 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/rep_barrier 2023-08-03 08:58:28,119 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-03 08:58:28,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:58:28,120 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-03 08:58:28,120 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/table 2023-08-03 08:58:28,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/table 2023-08-03 08:58:28,121 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-03 08:58:28,121 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:58:28,122 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740 2023-08-03 08:58:28,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740 2023-08-03 08:58:28,126 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-03 08:58:28,127 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-03 08:58:28,128 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=868674, jitterRate=0.10457643866539001}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-03 08:58:28,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-03 08:58:28,128 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1691053108086 2023-08-03 08:58:28,132 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-03 08:58:28,132 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-03 08:58:28,133 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45367,1691053107478, state=OPEN 2023-08-03 08:58:28,134 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-03 08:58:28,134 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-03 08:58:28,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-03 08:58:28,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45367,1691053107478 in 202 msec 2023-08-03 08:58:28,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-03 08:58:28,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 360 msec 2023-08-03 08:58:28,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 441 msec 2023-08-03 08:58:28,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1691053108141, completionTime=-1 2023-08-03 08:58:28,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-03 08:58:28,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-03 08:58:28,144 DEBUG [hconnection-0x53021f59-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-03 08:58:28,145 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-03 08:58:28,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-03 08:58:28,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1691053168147 2023-08-03 08:58:28,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1691053228147 2023-08-03 08:58:28,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-08-03 08:58:28,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36663,1691053107434-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:28,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36663,1691053107434-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:28,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36663,1691053107434-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:28,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36663, period=300000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:28,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-03 08:58:28,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-03 08:58:28,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-03 08:58:28,155 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-03 08:58:28,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-03 08:58:28,157 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-03 08:58:28,157 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-03 08:58:28,159 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/.tmp/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91 2023-08-03 08:58:28,160 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/.tmp/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91 empty. 2023-08-03 08:58:28,160 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/.tmp/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91 2023-08-03 08:58:28,160 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-03 08:58:28,172 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-03 08:58:28,173 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 90d26fc9af1c87f603bc8a6611d4bc91, NAME => 'hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/.tmp 2023-08-03 08:58:28,181 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:58:28,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 90d26fc9af1c87f603bc8a6611d4bc91, disabling compactions & flushes 2023-08-03 08:58:28,182 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. 2023-08-03 08:58:28,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. 2023-08-03 08:58:28,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. after waiting 0 ms 2023-08-03 08:58:28,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. 2023-08-03 08:58:28,182 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. 2023-08-03 08:58:28,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 90d26fc9af1c87f603bc8a6611d4bc91: 2023-08-03 08:58:28,184 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-03 08:58:28,185 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691053108185"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691053108185"}]},"ts":"1691053108185"} 2023-08-03 08:58:28,187 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-03 08:58:28,188 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-03 08:58:28,189 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053108188"}]},"ts":"1691053108188"} 2023-08-03 08:58:28,190 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-03 08:58:28,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=90d26fc9af1c87f603bc8a6611d4bc91, ASSIGN}] 2023-08-03 08:58:28,198 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=90d26fc9af1c87f603bc8a6611d4bc91, ASSIGN 2023-08-03 08:58:28,199 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=90d26fc9af1c87f603bc8a6611d4bc91, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45367,1691053107478; forceNewPlan=false, retain=false 2023-08-03 08:58:28,350 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=90d26fc9af1c87f603bc8a6611d4bc91, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:28,350 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691053108350"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691053108350"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691053108350"}]},"ts":"1691053108350"} 2023-08-03 08:58:28,352 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 90d26fc9af1c87f603bc8a6611d4bc91, server=jenkins-hbase4.apache.org,45367,1691053107478}] 2023-08-03 08:58:28,509 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. 2023-08-03 08:58:28,509 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 90d26fc9af1c87f603bc8a6611d4bc91, NAME => 'hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91.', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:58:28,509 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 90d26fc9af1c87f603bc8a6611d4bc91 2023-08-03 08:58:28,509 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:58:28,509 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 90d26fc9af1c87f603bc8a6611d4bc91 2023-08-03 08:58:28,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 90d26fc9af1c87f603bc8a6611d4bc91 2023-08-03 08:58:28,511 INFO [StoreOpener-90d26fc9af1c87f603bc8a6611d4bc91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 90d26fc9af1c87f603bc8a6611d4bc91 2023-08-03 08:58:28,512 DEBUG [StoreOpener-90d26fc9af1c87f603bc8a6611d4bc91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91/info 2023-08-03 08:58:28,512 DEBUG [StoreOpener-90d26fc9af1c87f603bc8a6611d4bc91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91/info 2023-08-03 08:58:28,513 INFO [StoreOpener-90d26fc9af1c87f603bc8a6611d4bc91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90d26fc9af1c87f603bc8a6611d4bc91 columnFamilyName info 2023-08-03 08:58:28,513 INFO [StoreOpener-90d26fc9af1c87f603bc8a6611d4bc91-1] regionserver.HStore(310): Store=90d26fc9af1c87f603bc8a6611d4bc91/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:58:28,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91 2023-08-03 08:58:28,516 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91 2023-08-03 08:58:28,518 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 90d26fc9af1c87f603bc8a6611d4bc91 2023-08-03 08:58:28,520 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:58:28,521 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 90d26fc9af1c87f603bc8a6611d4bc91; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=705617, jitterRate=-0.10276268422603607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:58:28,521 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 90d26fc9af1c87f603bc8a6611d4bc91: 2023-08-03 08:58:28,522 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91., pid=6, masterSystemTime=1691053108505 2023-08-03 08:58:28,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. 2023-08-03 08:58:28,524 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. 2023-08-03 08:58:28,525 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=90d26fc9af1c87f603bc8a6611d4bc91, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:28,525 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691053108524"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691053108524"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691053108524"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691053108524"}]},"ts":"1691053108524"} 2023-08-03 08:58:28,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-03 08:58:28,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 90d26fc9af1c87f603bc8a6611d4bc91, server=jenkins-hbase4.apache.org,45367,1691053107478 in 175 msec 2023-08-03 08:58:28,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-03 08:58:28,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=90d26fc9af1c87f603bc8a6611d4bc91, ASSIGN in 333 msec 2023-08-03 08:58:28,533 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-03 08:58:28,533 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053108533"}]},"ts":"1691053108533"} 2023-08-03 08:58:28,534 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-03 08:58:28,538 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-03 08:58:28,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 384 msec 2023-08-03 08:58:28,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-03 08:58:28,557 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-03 08:58:28,557 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:58:28,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-03 08:58:28,569 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-03 08:58:28,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-08-03 08:58:28,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-03 08:58:28,593 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-03 08:58:28,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-08-03 08:58:28,608 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-03 08:58:28,612 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-03 08:58:28,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.093sec 2023-08-03 08:58:28,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-03 08:58:28,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-03 08:58:28,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-03 08:58:28,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36663,1691053107434-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-03 08:58:28,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36663,1691053107434-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-03 08:58:28,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-03 08:58:28,614 DEBUG [Listener at localhost/37831] zookeeper.ReadOnlyZKClient(139): Connect 0x2630ef71 to 127.0.0.1:57170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-03 08:58:28,619 DEBUG [Listener at localhost/37831] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14abad4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-03 08:58:28,620 DEBUG [hconnection-0x4732fc7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-03 08:58:28,623 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-03 08:58:28,624 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36663,1691053107434 2023-08-03 08:58:28,624 INFO [Listener at localhost/37831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:58:28,629 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-03 08:58:28,629 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:58:28,630 INFO [Listener at localhost/37831] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-03 08:58:28,632 DEBUG [Listener at localhost/37831] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-03 08:58:28,634 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-03 08:58:28,636 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36663] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-03 08:58:28,636 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36663] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-03 08:58:28,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36663] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-03 08:58:28,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36663] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRolling 2023-08-03 08:58:28,640 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-08-03 08:58:28,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36663] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRolling" procId is: 9 2023-08-03 08:58:28,641 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-03 08:58:28,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-03 08:58:28,646 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/.tmp/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:28,647 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/.tmp/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52 empty. 2023-08-03 08:58:28,648 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/.tmp/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:28,648 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRolling regions 2023-08-03 08:58:28,661 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/.tmp/data/default/TestLogRolling-testLogRolling/.tabledesc/.tableinfo.0000000001 2023-08-03 08:58:28,663 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b793ca6f32a0f2dc3bf0c4bab161e52, NAME => 'TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/.tmp 2023-08-03 08:58:28,675 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:58:28,675 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1604): Closing 0b793ca6f32a0f2dc3bf0c4bab161e52, disabling compactions & flushes 2023-08-03 08:58:28,675 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:28,675 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:28,675 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. after waiting 0 ms 2023-08-03 08:58:28,675 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:28,675 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:28,675 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1558): Region close journal for 0b793ca6f32a0f2dc3bf0c4bab161e52: 2023-08-03 08:58:28,678 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ADD_TO_META 2023-08-03 08:58:28,679 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691053108679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691053108679"}]},"ts":"1691053108679"} 2023-08-03 08:58:28,681 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-03 08:58:28,682 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-03 08:58:28,682 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053108682"}]},"ts":"1691053108682"} 2023-08-03 08:58:28,684 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLING in hbase:meta 2023-08-03 08:58:28,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=0b793ca6f32a0f2dc3bf0c4bab161e52, ASSIGN}] 2023-08-03 08:58:28,688 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=0b793ca6f32a0f2dc3bf0c4bab161e52, ASSIGN 2023-08-03 08:58:28,689 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=0b793ca6f32a0f2dc3bf0c4bab161e52, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45367,1691053107478; forceNewPlan=false, retain=false 2023-08-03 08:58:28,840 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0b793ca6f32a0f2dc3bf0c4bab161e52, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:28,841 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691053108840"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691053108840"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691053108840"}]},"ts":"1691053108840"} 2023-08-03 08:58:28,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0b793ca6f32a0f2dc3bf0c4bab161e52, server=jenkins-hbase4.apache.org,45367,1691053107478}] 2023-08-03 08:58:28,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:28,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b793ca6f32a0f2dc3bf0c4bab161e52, NAME => 'TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:58:28,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:29,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:58:29,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:29,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:29,001 INFO [StoreOpener-0b793ca6f32a0f2dc3bf0c4bab161e52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:29,002 DEBUG [StoreOpener-0b793ca6f32a0f2dc3bf0c4bab161e52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info 2023-08-03 08:58:29,003 DEBUG [StoreOpener-0b793ca6f32a0f2dc3bf0c4bab161e52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info 2023-08-03 08:58:29,003 INFO [StoreOpener-0b793ca6f32a0f2dc3bf0c4bab161e52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b793ca6f32a0f2dc3bf0c4bab161e52 columnFamilyName info 2023-08-03 08:58:29,004 INFO [StoreOpener-0b793ca6f32a0f2dc3bf0c4bab161e52-1] regionserver.HStore(310): Store=0b793ca6f32a0f2dc3bf0c4bab161e52/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:58:29,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:29,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:29,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:29,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:58:29,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0b793ca6f32a0f2dc3bf0c4bab161e52; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=754646, jitterRate=-0.04041801393032074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:58:29,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0b793ca6f32a0f2dc3bf0c4bab161e52: 2023-08-03 08:58:29,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52., pid=11, masterSystemTime=1691053108995 2023-08-03 08:58:29,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:29,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:29,015 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0b793ca6f32a0f2dc3bf0c4bab161e52, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:29,016 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691053109015"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691053109015"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691053109015"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691053109015"}]},"ts":"1691053109015"} 2023-08-03 08:58:29,020 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-03 08:58:29,020 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0b793ca6f32a0f2dc3bf0c4bab161e52, server=jenkins-hbase4.apache.org,45367,1691053107478 in 175 msec 2023-08-03 08:58:29,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-03 08:58:29,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=0b793ca6f32a0f2dc3bf0c4bab161e52, ASSIGN in 333 msec 2023-08-03 08:58:29,023 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-03 08:58:29,024 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053109024"}]},"ts":"1691053109024"} 2023-08-03 08:58:29,025 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLED in hbase:meta 2023-08-03 08:58:29,028 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_POST_OPERATION 2023-08-03 08:58:29,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRolling in 392 msec 2023-08-03 08:58:31,501 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-03 08:58:33,765 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-03 08:58:33,765 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-03 08:58:33,766 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRolling' 2023-08-03 08:58:38,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-03 08:58:38,644 INFO [Listener at localhost/37831] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRolling, procId: 9 completed 2023-08-03 08:58:38,647 DEBUG [Listener at localhost/37831] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRolling 2023-08-03 08:58:38,647 DEBUG [Listener at localhost/37831] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:38,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:38,662 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 0b793ca6f32a0f2dc3bf0c4bab161e52 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-03 08:58:38,676 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=12 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/a42d3d1ccebd438a940e47eb788d6cb4 2023-08-03 08:58:38,685 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/a42d3d1ccebd438a940e47eb788d6cb4 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/a42d3d1ccebd438a940e47eb788d6cb4 2023-08-03 08:58:38,691 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/a42d3d1ccebd438a940e47eb788d6cb4, entries=8, sequenceid=12, filesize=13.0 K 2023-08-03 08:58:38,711 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=19.50 KB/19969 for 0b793ca6f32a0f2dc3bf0c4bab161e52 in 48ms, sequenceid=12, compaction requested=false 2023-08-03 08:58:38,712 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 0b793ca6f32a0f2dc3bf0c4bab161e52: 2023-08-03 08:58:38,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:38,714 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 0b793ca6f32a0f2dc3bf0c4bab161e52 1/1 column families, dataSize=21.55 KB heapSize=23.38 KB 2023-08-03 08:58:38,762 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=21.55 KB at sequenceid=36 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/5f17328655894956a374450e035de0e8 2023-08-03 08:58:38,780 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/5f17328655894956a374450e035de0e8 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/5f17328655894956a374450e035de0e8 2023-08-03 08:58:38,786 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/5f17328655894956a374450e035de0e8, entries=21, sequenceid=36, filesize=26.3 K 2023-08-03 08:58:38,787 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~21.55 KB/22071, heapSize ~23.37 KB/23928, currentSize=3.08 KB/3153 for 0b793ca6f32a0f2dc3bf0c4bab161e52 in 73ms, sequenceid=36, compaction requested=false 2023-08-03 08:58:38,787 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 0b793ca6f32a0f2dc3bf0c4bab161e52: 2023-08-03 08:58:38,787 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=39.3 K, sizeToCheck=16.0 K 2023-08-03 08:58:38,788 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-03 08:58:38,789 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/5f17328655894956a374450e035de0e8 because midkey is the same as first or last row 2023-08-03 08:58:40,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:40,733 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 0b793ca6f32a0f2dc3bf0c4bab161e52 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-03 08:58:40,765 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=47 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/158f37c184424e77a158e7e12dc890b5 2023-08-03 08:58:40,773 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=0b793ca6f32a0f2dc3bf0c4bab161e52, server=jenkins-hbase4.apache.org,45367,1691053107478 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-03 08:58:40,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] ipc.CallRunner(144): callId: 67 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:41032 deadline: 1691053130772, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=0b793ca6f32a0f2dc3bf0c4bab161e52, server=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:40,776 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/158f37c184424e77a158e7e12dc890b5 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/158f37c184424e77a158e7e12dc890b5 2023-08-03 08:58:40,783 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/158f37c184424e77a158e7e12dc890b5, entries=8, sequenceid=47, filesize=13.0 K 2023-08-03 08:58:40,784 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 0b793ca6f32a0f2dc3bf0c4bab161e52 in 52ms, sequenceid=47, compaction requested=true 2023-08-03 08:58:40,784 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 0b793ca6f32a0f2dc3bf0c4bab161e52: 2023-08-03 08:58:40,785 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=52.3 K, sizeToCheck=16.0 K 2023-08-03 08:58:40,785 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-03 08:58:40,785 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/5f17328655894956a374450e035de0e8 because midkey is the same as first or last row 2023-08-03 08:58:40,786 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:58:40,786 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-03 08:58:40,788 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 53524 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-03 08:58:40,788 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1912): 0b793ca6f32a0f2dc3bf0c4bab161e52/info is initiating minor compaction (all files) 2023-08-03 08:58:40,789 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0b793ca6f32a0f2dc3bf0c4bab161e52/info in TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:40,789 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/a42d3d1ccebd438a940e47eb788d6cb4, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/5f17328655894956a374450e035de0e8, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/158f37c184424e77a158e7e12dc890b5] into tmpdir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp, totalSize=52.3 K 2023-08-03 08:58:40,789 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting a42d3d1ccebd438a940e47eb788d6cb4, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1691053118651 2023-08-03 08:58:40,790 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 5f17328655894956a374450e035de0e8, keycount=21, bloomtype=ROW, size=26.3 K, encoding=NONE, compression=NONE, seqNum=36, earliestPutTs=1691053118663 2023-08-03 08:58:40,791 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 158f37c184424e77a158e7e12dc890b5, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1691053118715 2023-08-03 08:58:40,806 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0b793ca6f32a0f2dc3bf0c4bab161e52#info#compaction#18 average throughput is 18.54 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-03 08:58:40,848 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/05a9c8e69a384af19ba3dfadf37b2a82 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/05a9c8e69a384af19ba3dfadf37b2a82 2023-08-03 08:58:40,857 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0b793ca6f32a0f2dc3bf0c4bab161e52/info of 0b793ca6f32a0f2dc3bf0c4bab161e52 into 05a9c8e69a384af19ba3dfadf37b2a82(size=42.9 K), total size for store is 42.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-03 08:58:40,857 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0b793ca6f32a0f2dc3bf0c4bab161e52: 2023-08-03 08:58:40,857 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52., storeName=0b793ca6f32a0f2dc3bf0c4bab161e52/info, priority=13, startTime=1691053120786; duration=0sec 2023-08-03 08:58:40,859 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=42.9 K, sizeToCheck=16.0 K 2023-08-03 08:58:40,859 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-03 08:58:40,859 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.StoreUtils(129): cannot split hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/05a9c8e69a384af19ba3dfadf37b2a82 because midkey is the same as first or last row 2023-08-03 08:58:40,859 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:58:50,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:50,893 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 0b793ca6f32a0f2dc3bf0c4bab161e52 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-03 08:58:50,910 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=73 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/9f9f2ff62a2d40eba0c4594cd9d68075 2023-08-03 08:58:50,917 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/9f9f2ff62a2d40eba0c4594cd9d68075 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/9f9f2ff62a2d40eba0c4594cd9d68075 2023-08-03 08:58:50,922 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/9f9f2ff62a2d40eba0c4594cd9d68075, entries=22, sequenceid=73, filesize=27.4 K 2023-08-03 08:58:50,923 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=5.13 KB/5255 for 0b793ca6f32a0f2dc3bf0c4bab161e52 in 30ms, sequenceid=73, compaction requested=false 2023-08-03 08:58:50,923 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 0b793ca6f32a0f2dc3bf0c4bab161e52: 2023-08-03 08:58:50,924 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=70.3 K, sizeToCheck=16.0 K 2023-08-03 08:58:50,924 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-03 08:58:50,924 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/05a9c8e69a384af19ba3dfadf37b2a82 because midkey is the same as first or last row 2023-08-03 08:58:52,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:52,906 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 0b793ca6f32a0f2dc3bf0c4bab161e52 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-03 08:58:52,921 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=84 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/75b56255892d49f1a49ea775b66f59a5 2023-08-03 08:58:52,929 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/75b56255892d49f1a49ea775b66f59a5 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/75b56255892d49f1a49ea775b66f59a5 2023-08-03 08:58:52,936 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/75b56255892d49f1a49ea775b66f59a5, entries=8, sequenceid=84, filesize=13.0 K 2023-08-03 08:58:52,937 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=17.45 KB/17867 for 0b793ca6f32a0f2dc3bf0c4bab161e52 in 31ms, sequenceid=84, compaction requested=true 2023-08-03 08:58:52,938 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 0b793ca6f32a0f2dc3bf0c4bab161e52: 2023-08-03 08:58:52,938 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=83.2 K, sizeToCheck=16.0 K 2023-08-03 08:58:52,938 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-03 08:58:52,938 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/05a9c8e69a384af19ba3dfadf37b2a82 because midkey is the same as first or last row 2023-08-03 08:58:52,938 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:58:52,938 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-03 08:58:52,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:52,939 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 0b793ca6f32a0f2dc3bf0c4bab161e52 1/1 column families, dataSize=19.50 KB heapSize=21.18 KB 2023-08-03 08:58:52,940 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 85243 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-03 08:58:52,940 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1912): 0b793ca6f32a0f2dc3bf0c4bab161e52/info is initiating minor compaction (all files) 2023-08-03 08:58:52,940 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0b793ca6f32a0f2dc3bf0c4bab161e52/info in TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:52,940 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/05a9c8e69a384af19ba3dfadf37b2a82, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/9f9f2ff62a2d40eba0c4594cd9d68075, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/75b56255892d49f1a49ea775b66f59a5] into tmpdir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp, totalSize=83.2 K 2023-08-03 08:58:52,941 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 05a9c8e69a384af19ba3dfadf37b2a82, keycount=37, bloomtype=ROW, size=42.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1691053118651 2023-08-03 08:58:52,942 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 9f9f2ff62a2d40eba0c4594cd9d68075, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=73, earliestPutTs=1691053120733 2023-08-03 08:58:52,943 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 75b56255892d49f1a49ea775b66f59a5, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=84, earliestPutTs=1691053130894 2023-08-03 08:58:52,988 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0b793ca6f32a0f2dc3bf0c4bab161e52#info#compaction#22 average throughput is 13.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-03 08:58:53,014 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/bbfa646ef13a422083f243d929842b72 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/bbfa646ef13a422083f243d929842b72 2023-08-03 08:58:53,021 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0b793ca6f32a0f2dc3bf0c4bab161e52/info of 0b793ca6f32a0f2dc3bf0c4bab161e52 into bbfa646ef13a422083f243d929842b72(size=74.0 K), total size for store is 74.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-03 08:58:53,021 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0b793ca6f32a0f2dc3bf0c4bab161e52: 2023-08-03 08:58:53,021 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52., storeName=0b793ca6f32a0f2dc3bf0c4bab161e52/info, priority=13, startTime=1691053132938; duration=0sec 2023-08-03 08:58:53,022 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=74.0 K, sizeToCheck=16.0 K 2023-08-03 08:58:53,022 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-03 08:58:53,023 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit(227): Splitting TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52., compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:58:53,023 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:58:53,024 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36663] assignment.AssignmentManager(1140): Split request from jenkins-hbase4.apache.org,45367,1691053107478, parent={ENCODED => 0b793ca6f32a0f2dc3bf0c4bab161e52, NAME => 'TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.', STARTKEY => '', ENDKEY => ''} splitKey=row0064 2023-08-03 08:58:53,032 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36663] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:53,039 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36663] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=0b793ca6f32a0f2dc3bf0c4bab161e52, daughterA=a3a3fc9d114d77b9d286bc2f565feb6f, daughterB=ccb2fa656152c47a5916830b83034f83 2023-08-03 08:58:53,040 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=0b793ca6f32a0f2dc3bf0c4bab161e52, daughterA=a3a3fc9d114d77b9d286bc2f565feb6f, daughterB=ccb2fa656152c47a5916830b83034f83 2023-08-03 08:58:53,040 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=0b793ca6f32a0f2dc3bf0c4bab161e52, daughterA=a3a3fc9d114d77b9d286bc2f565feb6f, daughterB=ccb2fa656152c47a5916830b83034f83 2023-08-03 08:58:53,040 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=0b793ca6f32a0f2dc3bf0c4bab161e52, daughterA=a3a3fc9d114d77b9d286bc2f565feb6f, daughterB=ccb2fa656152c47a5916830b83034f83 2023-08-03 08:58:53,049 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=0b793ca6f32a0f2dc3bf0c4bab161e52, UNASSIGN}] 2023-08-03 08:58:53,050 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=0b793ca6f32a0f2dc3bf0c4bab161e52, UNASSIGN 2023-08-03 08:58:53,051 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0b793ca6f32a0f2dc3bf0c4bab161e52, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:53,051 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691053133051"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691053133051"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691053133051"}]},"ts":"1691053133051"} 2023-08-03 08:58:53,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; CloseRegionProcedure 0b793ca6f32a0f2dc3bf0c4bab161e52, server=jenkins-hbase4.apache.org,45367,1691053107478}] 2023-08-03 08:58:53,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:53,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0b793ca6f32a0f2dc3bf0c4bab161e52, disabling compactions & flushes 2023-08-03 08:58:53,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 0 compactions & cache flush to complete for region TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:53,376 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=19.50 KB at sequenceid=106 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/59dd98ff254c49a7b1382699f8e8937f 2023-08-03 08:58:53,383 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/59dd98ff254c49a7b1382699f8e8937f as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/59dd98ff254c49a7b1382699f8e8937f 2023-08-03 08:58:53,390 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/59dd98ff254c49a7b1382699f8e8937f, entries=19, sequenceid=106, filesize=24.3 K 2023-08-03 08:58:53,391 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~19.50 KB/19969, heapSize ~21.16 KB/21672, currentSize=10.26 KB/10510 for 0b793ca6f32a0f2dc3bf0c4bab161e52 in 452ms, sequenceid=106, compaction requested=false 2023-08-03 08:58:53,391 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 0b793ca6f32a0f2dc3bf0c4bab161e52: 2023-08-03 08:58:53,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:53,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:53,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. after waiting 0 ms 2023-08-03 08:58:53,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:53,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0b793ca6f32a0f2dc3bf0c4bab161e52 1/1 column families, dataSize=10.26 KB heapSize=11.27 KB 2023-08-03 08:58:53,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=10.26 KB at sequenceid=120 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/ee60df6d51674b79a8dad9f15b42cd03 2023-08-03 08:58:53,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.tmp/info/ee60df6d51674b79a8dad9f15b42cd03 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/ee60df6d51674b79a8dad9f15b42cd03 2023-08-03 08:58:53,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/ee60df6d51674b79a8dad9f15b42cd03, entries=10, sequenceid=120, filesize=15.0 K 2023-08-03 08:58:53,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~10.26 KB/10510, heapSize ~11.25 KB/11520, currentSize=0 B/0 for 0b793ca6f32a0f2dc3bf0c4bab161e52 in 26ms, sequenceid=120, compaction requested=true 2023-08-03 08:58:53,425 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/a42d3d1ccebd438a940e47eb788d6cb4, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/5f17328655894956a374450e035de0e8, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/05a9c8e69a384af19ba3dfadf37b2a82, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/158f37c184424e77a158e7e12dc890b5, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/9f9f2ff62a2d40eba0c4594cd9d68075, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/75b56255892d49f1a49ea775b66f59a5] to archive 2023-08-03 08:58:53,426 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-03 08:58:53,428 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/a42d3d1ccebd438a940e47eb788d6cb4 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/a42d3d1ccebd438a940e47eb788d6cb4 2023-08-03 08:58:53,430 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/5f17328655894956a374450e035de0e8 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/5f17328655894956a374450e035de0e8 2023-08-03 08:58:53,432 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/05a9c8e69a384af19ba3dfadf37b2a82 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/05a9c8e69a384af19ba3dfadf37b2a82 2023-08-03 08:58:53,433 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/158f37c184424e77a158e7e12dc890b5 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/158f37c184424e77a158e7e12dc890b5 2023-08-03 08:58:53,437 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/9f9f2ff62a2d40eba0c4594cd9d68075 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/9f9f2ff62a2d40eba0c4594cd9d68075 2023-08-03 08:58:53,439 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/75b56255892d49f1a49ea775b66f59a5 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/75b56255892d49f1a49ea775b66f59a5 2023-08-03 08:58:53,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/recovered.edits/123.seqid, newMaxSeqId=123, maxSeqId=1 2023-08-03 08:58:53,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. 2023-08-03 08:58:53,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0b793ca6f32a0f2dc3bf0c4bab161e52: 2023-08-03 08:58:53,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:53,449 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0b793ca6f32a0f2dc3bf0c4bab161e52, regionState=CLOSED 2023-08-03 08:58:53,449 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691053133449"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691053133449"}]},"ts":"1691053133449"} 2023-08-03 08:58:53,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-08-03 08:58:53,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; CloseRegionProcedure 0b793ca6f32a0f2dc3bf0c4bab161e52, server=jenkins-hbase4.apache.org,45367,1691053107478 in 398 msec 2023-08-03 08:58:53,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-08-03 08:58:53,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=0b793ca6f32a0f2dc3bf0c4bab161e52, UNASSIGN in 404 msec 2023-08-03 08:58:53,474 INFO [PEWorker-4] assignment.SplitTableRegionProcedure(694): pid=12 splitting 3 storefiles, region=0b793ca6f32a0f2dc3bf0c4bab161e52, threads=3 2023-08-03 08:58:53,475 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/59dd98ff254c49a7b1382699f8e8937f for region: 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:53,475 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/bbfa646ef13a422083f243d929842b72 for region: 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:53,476 DEBUG [StoreFileSplitter-pool-2] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/ee60df6d51674b79a8dad9f15b42cd03 for region: 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:53,486 DEBUG [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/59dd98ff254c49a7b1382699f8e8937f, top=true 2023-08-03 08:58:53,488 DEBUG [StoreFileSplitter-pool-2] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/ee60df6d51674b79a8dad9f15b42cd03, top=true 2023-08-03 08:58:53,496 INFO [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.splits/ccb2fa656152c47a5916830b83034f83/info/TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-59dd98ff254c49a7b1382699f8e8937f for child: ccb2fa656152c47a5916830b83034f83, parent: 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:53,497 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/59dd98ff254c49a7b1382699f8e8937f for region: 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:53,499 INFO [StoreFileSplitter-pool-2] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/.splits/ccb2fa656152c47a5916830b83034f83/info/TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-ee60df6d51674b79a8dad9f15b42cd03 for child: ccb2fa656152c47a5916830b83034f83, parent: 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:53,499 DEBUG [StoreFileSplitter-pool-2] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/ee60df6d51674b79a8dad9f15b42cd03 for region: 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:53,512 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/bbfa646ef13a422083f243d929842b72 for region: 0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:58:53,512 DEBUG [PEWorker-4] assignment.SplitTableRegionProcedure(755): pid=12 split storefiles for region 0b793ca6f32a0f2dc3bf0c4bab161e52 Daughter A: 1 storefiles, Daughter B: 3 storefiles. 2023-08-03 08:58:53,547 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f/recovered.edits/123.seqid, newMaxSeqId=123, maxSeqId=-1 2023-08-03 08:58:53,550 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/recovered.edits/123.seqid, newMaxSeqId=123, maxSeqId=-1 2023-08-03 08:58:53,553 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691053133552"},{"qualifier":"splitA","vlen":70,"tag":[],"timestamp":"1691053133552"},{"qualifier":"splitB","vlen":70,"tag":[],"timestamp":"1691053133552"}]},"ts":"1691053133552"} 2023-08-03 08:58:53,553 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691053133552"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691053133552"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691053133552"}]},"ts":"1691053133552"} 2023-08-03 08:58:53,553 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691053133552"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691053133552"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691053133552"}]},"ts":"1691053133552"} 2023-08-03 08:58:53,609 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45367] regionserver.HRegion(9158): Flush requested on 1588230740 2023-08-03 08:58:53,609 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy(69): Since none of the CFs were above the size, flushing all. 2023-08-03 08:58:53,609 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=4.82 KB heapSize=8.36 KB 2023-08-03 08:58:53,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=a3a3fc9d114d77b9d286bc2f565feb6f, ASSIGN}, {pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=ccb2fa656152c47a5916830b83034f83, ASSIGN}] 2023-08-03 08:58:53,622 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=a3a3fc9d114d77b9d286bc2f565feb6f, ASSIGN 2023-08-03 08:58:53,622 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=ccb2fa656152c47a5916830b83034f83, ASSIGN 2023-08-03 08:58:53,623 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=a3a3fc9d114d77b9d286bc2f565feb6f, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,45367,1691053107478; forceNewPlan=false, retain=false 2023-08-03 08:58:53,623 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=ccb2fa656152c47a5916830b83034f83, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,45367,1691053107478; forceNewPlan=false, retain=false 2023-08-03 08:58:53,624 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.61 KB at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/.tmp/info/69def109596c4a7aa2262a384208aeed 2023-08-03 08:58:53,704 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=216 B at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/.tmp/table/5f7e26a084494cc98f0ffe693c344491 2023-08-03 08:58:53,711 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/.tmp/info/69def109596c4a7aa2262a384208aeed as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/info/69def109596c4a7aa2262a384208aeed 2023-08-03 08:58:53,718 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/info/69def109596c4a7aa2262a384208aeed, entries=29, sequenceid=17, filesize=8.6 K 2023-08-03 08:58:53,720 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/.tmp/table/5f7e26a084494cc98f0ffe693c344491 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/table/5f7e26a084494cc98f0ffe693c344491 2023-08-03 08:58:53,726 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/table/5f7e26a084494cc98f0ffe693c344491, entries=4, sequenceid=17, filesize=4.8 K 2023-08-03 08:58:53,728 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~4.82 KB/4934, heapSize ~8.08 KB/8272, currentSize=0 B/0 for 1588230740 in 119ms, sequenceid=17, compaction requested=false 2023-08-03 08:58:53,728 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-08-03 08:58:53,774 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=a3a3fc9d114d77b9d286bc2f565feb6f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:53,774 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ccb2fa656152c47a5916830b83034f83, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:53,775 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691053133774"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691053133774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691053133774"}]},"ts":"1691053133774"} 2023-08-03 08:58:53,775 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691053133774"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691053133774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691053133774"}]},"ts":"1691053133774"} 2023-08-03 08:58:53,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure ccb2fa656152c47a5916830b83034f83, server=jenkins-hbase4.apache.org,45367,1691053107478}] 2023-08-03 08:58:53,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=15, state=RUNNABLE; OpenRegionProcedure a3a3fc9d114d77b9d286bc2f565feb6f, server=jenkins-hbase4.apache.org,45367,1691053107478}] 2023-08-03 08:58:53,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:58:53,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ccb2fa656152c47a5916830b83034f83, NAME => 'TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.', STARTKEY => 'row0064', ENDKEY => ''} 2023-08-03 08:58:53,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling ccb2fa656152c47a5916830b83034f83 2023-08-03 08:58:53,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:58:53,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ccb2fa656152c47a5916830b83034f83 2023-08-03 08:58:53,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ccb2fa656152c47a5916830b83034f83 2023-08-03 08:58:53,934 INFO [StoreOpener-ccb2fa656152c47a5916830b83034f83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ccb2fa656152c47a5916830b83034f83 2023-08-03 08:58:53,935 DEBUG [StoreOpener-ccb2fa656152c47a5916830b83034f83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info 2023-08-03 08:58:53,935 DEBUG [StoreOpener-ccb2fa656152c47a5916830b83034f83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info 2023-08-03 08:58:53,936 INFO [StoreOpener-ccb2fa656152c47a5916830b83034f83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ccb2fa656152c47a5916830b83034f83 columnFamilyName info 2023-08-03 08:58:53,947 DEBUG [StoreOpener-ccb2fa656152c47a5916830b83034f83-1] regionserver.HStore(539): loaded hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-59dd98ff254c49a7b1382699f8e8937f 2023-08-03 08:58:53,951 DEBUG [StoreOpener-ccb2fa656152c47a5916830b83034f83-1] regionserver.HStore(539): loaded hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-ee60df6d51674b79a8dad9f15b42cd03 2023-08-03 08:58:53,959 DEBUG [StoreOpener-ccb2fa656152c47a5916830b83034f83-1] regionserver.HStore(539): loaded hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/bbfa646ef13a422083f243d929842b72.0b793ca6f32a0f2dc3bf0c4bab161e52->hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/bbfa646ef13a422083f243d929842b72-top 2023-08-03 08:58:53,960 INFO [StoreOpener-ccb2fa656152c47a5916830b83034f83-1] regionserver.HStore(310): Store=ccb2fa656152c47a5916830b83034f83/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:58:53,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83 2023-08-03 08:58:53,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83 2023-08-03 08:58:53,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ccb2fa656152c47a5916830b83034f83 2023-08-03 08:58:53,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ccb2fa656152c47a5916830b83034f83; next sequenceid=124; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=829194, jitterRate=0.05437535047531128}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:58:53,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:58:53,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83., pid=17, masterSystemTime=1691053133928 2023-08-03 08:58:53,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:58:53,971 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-03 08:58:53,972 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:58:53,972 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1912): ccb2fa656152c47a5916830b83034f83/info is initiating minor compaction (all files) 2023-08-03 08:58:53,972 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ccb2fa656152c47a5916830b83034f83/info in TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:58:53,972 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/bbfa646ef13a422083f243d929842b72.0b793ca6f32a0f2dc3bf0c4bab161e52->hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/bbfa646ef13a422083f243d929842b72-top, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-59dd98ff254c49a7b1382699f8e8937f, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-ee60df6d51674b79a8dad9f15b42cd03] into tmpdir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp, totalSize=113.3 K 2023-08-03 08:58:53,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:58:53,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:58:53,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f. 2023-08-03 08:58:53,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a3a3fc9d114d77b9d286bc2f565feb6f, NAME => 'TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f.', STARTKEY => '', ENDKEY => 'row0064'} 2023-08-03 08:58:53,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling a3a3fc9d114d77b9d286bc2f565feb6f 2023-08-03 08:58:53,973 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ccb2fa656152c47a5916830b83034f83, regionState=OPEN, openSeqNum=124, regionLocation=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:53,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:58:53,974 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting bbfa646ef13a422083f243d929842b72.0b793ca6f32a0f2dc3bf0c4bab161e52, keycount=33, bloomtype=ROW, size=74.0 K, encoding=NONE, compression=NONE, seqNum=85, earliestPutTs=1691053118651 2023-08-03 08:58:53,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a3a3fc9d114d77b9d286bc2f565feb6f 2023-08-03 08:58:53,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a3a3fc9d114d77b9d286bc2f565feb6f 2023-08-03 08:58:53,974 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691053133973"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691053133973"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691053133973"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691053133973"}]},"ts":"1691053133973"} 2023-08-03 08:58:53,975 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-59dd98ff254c49a7b1382699f8e8937f, keycount=19, bloomtype=ROW, size=24.3 K, encoding=NONE, compression=NONE, seqNum=106, earliestPutTs=1691053132907 2023-08-03 08:58:53,975 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-ee60df6d51674b79a8dad9f15b42cd03, keycount=10, bloomtype=ROW, size=15.0 K, encoding=NONE, compression=NONE, seqNum=120, earliestPutTs=1691053132940 2023-08-03 08:58:53,976 INFO [StoreOpener-a3a3fc9d114d77b9d286bc2f565feb6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a3a3fc9d114d77b9d286bc2f565feb6f 2023-08-03 08:58:53,978 DEBUG [StoreOpener-a3a3fc9d114d77b9d286bc2f565feb6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f/info 2023-08-03 08:58:53,978 DEBUG [StoreOpener-a3a3fc9d114d77b9d286bc2f565feb6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f/info 2023-08-03 08:58:53,979 INFO [StoreOpener-a3a3fc9d114d77b9d286bc2f565feb6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3a3fc9d114d77b9d286bc2f565feb6f columnFamilyName info 2023-08-03 08:58:53,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-08-03 08:58:53,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure ccb2fa656152c47a5916830b83034f83, server=jenkins-hbase4.apache.org,45367,1691053107478 in 201 msec 2023-08-03 08:58:53,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=ccb2fa656152c47a5916830b83034f83, ASSIGN in 362 msec 2023-08-03 08:58:54,016 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] throttle.PressureAwareThroughputController(145): ccb2fa656152c47a5916830b83034f83#info#compaction#26 average throughput is 16.54 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-03 08:58:54,034 DEBUG [StoreOpener-a3a3fc9d114d77b9d286bc2f565feb6f-1] regionserver.HStore(539): loaded hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f/info/bbfa646ef13a422083f243d929842b72.0b793ca6f32a0f2dc3bf0c4bab161e52->hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/bbfa646ef13a422083f243d929842b72-bottom 2023-08-03 08:58:54,038 INFO [StoreOpener-a3a3fc9d114d77b9d286bc2f565feb6f-1] regionserver.HStore(310): Store=a3a3fc9d114d77b9d286bc2f565feb6f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:58:54,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f 2023-08-03 08:58:54,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f 2023-08-03 08:58:54,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a3a3fc9d114d77b9d286bc2f565feb6f 2023-08-03 08:58:54,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a3a3fc9d114d77b9d286bc2f565feb6f; next sequenceid=124; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=690049, jitterRate=-0.12255753576755524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:58:54,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a3a3fc9d114d77b9d286bc2f565feb6f: 2023-08-03 08:58:54,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f., pid=18, masterSystemTime=1691053133928 2023-08-03 08:58:54,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-08-03 08:58:54,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f. 2023-08-03 08:58:54,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f. 2023-08-03 08:58:54,052 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=a3a3fc9d114d77b9d286bc2f565feb6f, regionState=OPEN, openSeqNum=124, regionLocation=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:54,052 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691053134052"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691053134052"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691053134052"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691053134052"}]},"ts":"1691053134052"} 2023-08-03 08:58:54,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=15 2023-08-03 08:58:54,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=15, state=SUCCESS; OpenRegionProcedure a3a3fc9d114d77b9d286bc2f565feb6f, server=jenkins-hbase4.apache.org,45367,1691053107478 in 277 msec 2023-08-03 08:58:54,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=12 2023-08-03 08:58:54,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=a3a3fc9d114d77b9d286bc2f565feb6f, ASSIGN in 438 msec 2023-08-03 08:58:54,063 DEBUG [RS:0;jenkins-hbase4:45367-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-08-03 08:58:54,067 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=0b793ca6f32a0f2dc3bf0c4bab161e52, daughterA=a3a3fc9d114d77b9d286bc2f565feb6f, daughterB=ccb2fa656152c47a5916830b83034f83 in 1.0270 sec 2023-08-03 08:58:54,072 INFO [RS:0;jenkins-hbase4:45367-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f. 2023-08-03 08:58:54,072 DEBUG [RS:0;jenkins-hbase4:45367-longCompactions-0] regionserver.HStore(1912): a3a3fc9d114d77b9d286bc2f565feb6f/info is initiating minor compaction (all files) 2023-08-03 08:58:54,072 INFO [RS:0;jenkins-hbase4:45367-longCompactions-0] regionserver.HRegion(2259): Starting compaction of a3a3fc9d114d77b9d286bc2f565feb6f/info in TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f. 2023-08-03 08:58:54,073 INFO [RS:0;jenkins-hbase4:45367-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f/info/bbfa646ef13a422083f243d929842b72.0b793ca6f32a0f2dc3bf0c4bab161e52->hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/bbfa646ef13a422083f243d929842b72-bottom] into tmpdir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f/.tmp, totalSize=74.0 K 2023-08-03 08:58:54,074 DEBUG [RS:0;jenkins-hbase4:45367-longCompactions-0] compactions.Compactor(207): Compacting bbfa646ef13a422083f243d929842b72.0b793ca6f32a0f2dc3bf0c4bab161e52, keycount=33, bloomtype=ROW, size=74.0 K, encoding=NONE, compression=NONE, seqNum=84, earliestPutTs=1691053118651 2023-08-03 08:58:54,083 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/adeb3873a99048ddafaaeb4c6c468cdc as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/adeb3873a99048ddafaaeb4c6c468cdc 2023-08-03 08:58:54,084 INFO [RS:0;jenkins-hbase4:45367-longCompactions-0] throttle.PressureAwareThroughputController(145): a3a3fc9d114d77b9d286bc2f565feb6f#info#compaction#27 average throughput is 15.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-03 08:58:54,102 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ccb2fa656152c47a5916830b83034f83/info of ccb2fa656152c47a5916830b83034f83 into adeb3873a99048ddafaaeb4c6c468cdc(size=39.0 K), total size for store is 39.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-03 08:58:54,102 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:58:54,102 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83., storeName=ccb2fa656152c47a5916830b83034f83/info, priority=13, startTime=1691053133970; duration=0sec 2023-08-03 08:58:54,102 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:58:54,115 DEBUG [RS:0;jenkins-hbase4:45367-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f/.tmp/info/21ffec07208149deb16c39182cfb33cc as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f/info/21ffec07208149deb16c39182cfb33cc 2023-08-03 08:58:54,122 INFO [RS:0;jenkins-hbase4:45367-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in a3a3fc9d114d77b9d286bc2f565feb6f/info of a3a3fc9d114d77b9d286bc2f565feb6f into 21ffec07208149deb16c39182cfb33cc(size=69.7 K), total size for store is 69.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-03 08:58:54,123 DEBUG [RS:0;jenkins-hbase4:45367-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for a3a3fc9d114d77b9d286bc2f565feb6f: 2023-08-03 08:58:54,123 INFO [RS:0;jenkins-hbase4:45367-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f., storeName=a3a3fc9d114d77b9d286bc2f565feb6f/info, priority=15, startTime=1691053134049; duration=0sec 2023-08-03 08:58:54,123 DEBUG [RS:0;jenkins-hbase4:45367-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:58:54,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:41032 deadline: 1691053144963, exception=org.apache.hadoop.hbase.NotServingRegionException: TestLogRolling-testLogRolling,,1691053108636.0b793ca6f32a0f2dc3bf0c4bab161e52. is not online on jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:58:58,987 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-03 08:59:05,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:05,024 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing ccb2fa656152c47a5916830b83034f83 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-03 08:59:05,038 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=135 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/08caaa14c3ec47dcbe9a949325d082a6 2023-08-03 08:59:05,045 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/08caaa14c3ec47dcbe9a949325d082a6 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/08caaa14c3ec47dcbe9a949325d082a6 2023-08-03 08:59:05,051 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=ccb2fa656152c47a5916830b83034f83, server=jenkins-hbase4.apache.org,45367,1691053107478 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-03 08:59:05,051 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/08caaa14c3ec47dcbe9a949325d082a6, entries=8, sequenceid=135, filesize=13.0 K 2023-08-03 08:59:05,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:41032 deadline: 1691053155051, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=ccb2fa656152c47a5916830b83034f83, server=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:59:05,053 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for ccb2fa656152c47a5916830b83034f83 in 29ms, sequenceid=135, compaction requested=false 2023-08-03 08:59:05,053 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:15,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:15,114 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing ccb2fa656152c47a5916830b83034f83 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-03 08:59:15,129 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/9ed11c93713b4d85b1980b6e5acafbb4 2023-08-03 08:59:15,138 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/9ed11c93713b4d85b1980b6e5acafbb4 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/9ed11c93713b4d85b1980b6e5acafbb4 2023-08-03 08:59:15,144 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/9ed11c93713b4d85b1980b6e5acafbb4, entries=22, sequenceid=160, filesize=27.4 K 2023-08-03 08:59:15,147 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for ccb2fa656152c47a5916830b83034f83 in 33ms, sequenceid=160, compaction requested=true 2023-08-03 08:59:15,147 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:15,147 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:59:15,147 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-03 08:59:15,149 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 81224 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-03 08:59:15,149 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1912): ccb2fa656152c47a5916830b83034f83/info is initiating minor compaction (all files) 2023-08-03 08:59:15,149 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ccb2fa656152c47a5916830b83034f83/info in TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:59:15,149 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/adeb3873a99048ddafaaeb4c6c468cdc, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/08caaa14c3ec47dcbe9a949325d082a6, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/9ed11c93713b4d85b1980b6e5acafbb4] into tmpdir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp, totalSize=79.3 K 2023-08-03 08:59:15,150 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting adeb3873a99048ddafaaeb4c6c468cdc, keycount=33, bloomtype=ROW, size=39.0 K, encoding=NONE, compression=NONE, seqNum=120, earliestPutTs=1691053130901 2023-08-03 08:59:15,150 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 08caaa14c3ec47dcbe9a949325d082a6, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=135, earliestPutTs=1691053145015 2023-08-03 08:59:15,151 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 9ed11c93713b4d85b1980b6e5acafbb4, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=160, earliestPutTs=1691053145024 2023-08-03 08:59:15,168 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] throttle.PressureAwareThroughputController(145): ccb2fa656152c47a5916830b83034f83#info#compaction#30 average throughput is 15.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-03 08:59:15,201 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/e0d38183f639479eab0b0746db34313f as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/e0d38183f639479eab0b0746db34313f 2023-08-03 08:59:15,209 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ccb2fa656152c47a5916830b83034f83/info of ccb2fa656152c47a5916830b83034f83 into e0d38183f639479eab0b0746db34313f(size=70.0 K), total size for store is 70.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-03 08:59:15,209 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:15,209 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83., storeName=ccb2fa656152c47a5916830b83034f83/info, priority=13, startTime=1691053155147; duration=0sec 2023-08-03 08:59:15,209 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:59:17,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:17,134 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing ccb2fa656152c47a5916830b83034f83 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-03 08:59:17,178 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=ccb2fa656152c47a5916830b83034f83, server=jenkins-hbase4.apache.org,45367,1691053107478 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-03 08:59:17,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] ipc.CallRunner(144): callId: 172 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:41032 deadline: 1691053167178, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=ccb2fa656152c47a5916830b83034f83, server=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:59:17,194 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=172 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/a7ca457cbb40441482b0c3637803a6c9 2023-08-03 08:59:17,204 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/a7ca457cbb40441482b0c3637803a6c9 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/a7ca457cbb40441482b0c3637803a6c9 2023-08-03 08:59:17,209 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/a7ca457cbb40441482b0c3637803a6c9, entries=8, sequenceid=172, filesize=13.0 K 2023-08-03 08:59:17,210 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for ccb2fa656152c47a5916830b83034f83 in 76ms, sequenceid=172, compaction requested=false 2023-08-03 08:59:17,211 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:27,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:27,266 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing ccb2fa656152c47a5916830b83034f83 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-03 08:59:27,300 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=197 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/5c66b955b5e84d95a3a567f5e827d510 2023-08-03 08:59:27,307 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/5c66b955b5e84d95a3a567f5e827d510 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/5c66b955b5e84d95a3a567f5e827d510 2023-08-03 08:59:27,313 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/5c66b955b5e84d95a3a567f5e827d510, entries=22, sequenceid=197, filesize=27.4 K 2023-08-03 08:59:27,314 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=4.11 KB/4204 for ccb2fa656152c47a5916830b83034f83 in 48ms, sequenceid=197, compaction requested=true 2023-08-03 08:59:27,314 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:27,314 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:59:27,314 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-03 08:59:27,316 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 112988 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-03 08:59:27,316 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1912): ccb2fa656152c47a5916830b83034f83/info is initiating minor compaction (all files) 2023-08-03 08:59:27,316 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ccb2fa656152c47a5916830b83034f83/info in TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:59:27,316 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/e0d38183f639479eab0b0746db34313f, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/a7ca457cbb40441482b0c3637803a6c9, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/5c66b955b5e84d95a3a567f5e827d510] into tmpdir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp, totalSize=110.3 K 2023-08-03 08:59:27,317 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting e0d38183f639479eab0b0746db34313f, keycount=63, bloomtype=ROW, size=70.0 K, encoding=NONE, compression=NONE, seqNum=160, earliestPutTs=1691053130901 2023-08-03 08:59:27,317 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting a7ca457cbb40441482b0c3637803a6c9, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=172, earliestPutTs=1691053155115 2023-08-03 08:59:27,318 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 5c66b955b5e84d95a3a567f5e827d510, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=197, earliestPutTs=1691053157135 2023-08-03 08:59:27,336 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] throttle.PressureAwareThroughputController(145): ccb2fa656152c47a5916830b83034f83#info#compaction#33 average throughput is 31.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-03 08:59:27,353 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/9b3768eb5bb54a0dbff28db3c2b159d0 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/9b3768eb5bb54a0dbff28db3c2b159d0 2023-08-03 08:59:27,360 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ccb2fa656152c47a5916830b83034f83/info of ccb2fa656152c47a5916830b83034f83 into 9b3768eb5bb54a0dbff28db3c2b159d0(size=101.0 K), total size for store is 101.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-03 08:59:27,360 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:27,361 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83., storeName=ccb2fa656152c47a5916830b83034f83/info, priority=13, startTime=1691053167314; duration=0sec 2023-08-03 08:59:27,361 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:59:29,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:29,297 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing ccb2fa656152c47a5916830b83034f83 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-03 08:59:29,309 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=209 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/6b1cc2a56fb140c0944111fdaab77f8e 2023-08-03 08:59:29,316 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/6b1cc2a56fb140c0944111fdaab77f8e as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/6b1cc2a56fb140c0944111fdaab77f8e 2023-08-03 08:59:29,323 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/6b1cc2a56fb140c0944111fdaab77f8e, entries=8, sequenceid=209, filesize=13.0 K 2023-08-03 08:59:29,324 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=17.45 KB/17867 for ccb2fa656152c47a5916830b83034f83 in 27ms, sequenceid=209, compaction requested=false 2023-08-03 08:59:29,324 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:29,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:29,325 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing ccb2fa656152c47a5916830b83034f83 1/1 column families, dataSize=19.50 KB heapSize=21.18 KB 2023-08-03 08:59:29,342 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=19.50 KB at sequenceid=231 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/ea7761df9b5646209e38e97fe7aa2514 2023-08-03 08:59:29,348 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/ea7761df9b5646209e38e97fe7aa2514 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/ea7761df9b5646209e38e97fe7aa2514 2023-08-03 08:59:29,354 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/ea7761df9b5646209e38e97fe7aa2514, entries=19, sequenceid=231, filesize=24.3 K 2023-08-03 08:59:29,355 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~19.50 KB/19969, heapSize ~21.16 KB/21672, currentSize=9.24 KB/9459 for ccb2fa656152c47a5916830b83034f83 in 29ms, sequenceid=231, compaction requested=true 2023-08-03 08:59:29,355 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:29,355 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:59:29,355 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-03 08:59:29,356 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 141594 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-03 08:59:29,356 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1912): ccb2fa656152c47a5916830b83034f83/info is initiating minor compaction (all files) 2023-08-03 08:59:29,356 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ccb2fa656152c47a5916830b83034f83/info in TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:59:29,356 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/9b3768eb5bb54a0dbff28db3c2b159d0, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/6b1cc2a56fb140c0944111fdaab77f8e, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/ea7761df9b5646209e38e97fe7aa2514] into tmpdir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp, totalSize=138.3 K 2023-08-03 08:59:29,357 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 9b3768eb5bb54a0dbff28db3c2b159d0, keycount=93, bloomtype=ROW, size=101.0 K, encoding=NONE, compression=NONE, seqNum=197, earliestPutTs=1691053130901 2023-08-03 08:59:29,357 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 6b1cc2a56fb140c0944111fdaab77f8e, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=209, earliestPutTs=1691053167267 2023-08-03 08:59:29,357 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting ea7761df9b5646209e38e97fe7aa2514, keycount=19, bloomtype=ROW, size=24.3 K, encoding=NONE, compression=NONE, seqNum=231, earliestPutTs=1691053169298 2023-08-03 08:59:29,369 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] throttle.PressureAwareThroughputController(145): ccb2fa656152c47a5916830b83034f83#info#compaction#36 average throughput is 60.14 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-03 08:59:29,383 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/8e135ad3d4b245febac70c43ae19c61a as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/8e135ad3d4b245febac70c43ae19c61a 2023-08-03 08:59:29,389 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ccb2fa656152c47a5916830b83034f83/info of ccb2fa656152c47a5916830b83034f83 into 8e135ad3d4b245febac70c43ae19c61a(size=129.0 K), total size for store is 129.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-03 08:59:29,389 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:29,389 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83., storeName=ccb2fa656152c47a5916830b83034f83/info, priority=13, startTime=1691053169355; duration=0sec 2023-08-03 08:59:29,389 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:59:31,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:31,339 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing ccb2fa656152c47a5916830b83034f83 1/1 column families, dataSize=10.26 KB heapSize=11.27 KB 2023-08-03 08:59:31,351 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=10.26 KB at sequenceid=245 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/377a7e100dde469a9695dda6c941d90b 2023-08-03 08:59:31,357 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/377a7e100dde469a9695dda6c941d90b as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/377a7e100dde469a9695dda6c941d90b 2023-08-03 08:59:31,362 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=ccb2fa656152c47a5916830b83034f83, server=jenkins-hbase4.apache.org,45367,1691053107478 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-03 08:59:31,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] ipc.CallRunner(144): callId: 231 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:41032 deadline: 1691053181362, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=ccb2fa656152c47a5916830b83034f83, server=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:59:31,363 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/377a7e100dde469a9695dda6c941d90b, entries=10, sequenceid=245, filesize=15.0 K 2023-08-03 08:59:31,364 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~10.26 KB/10510, heapSize ~11.25 KB/11520, currentSize=19.50 KB/19969 for ccb2fa656152c47a5916830b83034f83 in 25ms, sequenceid=245, compaction requested=false 2023-08-03 08:59:31,364 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:41,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:41,394 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing ccb2fa656152c47a5916830b83034f83 1/1 column families, dataSize=20.53 KB heapSize=22.28 KB 2023-08-03 08:59:41,408 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=ccb2fa656152c47a5916830b83034f83, server=jenkins-hbase4.apache.org,45367,1691053107478 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-03 08:59:41,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:41032 deadline: 1691053191408, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=ccb2fa656152c47a5916830b83034f83, server=jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:59:41,409 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=20.53 KB at sequenceid=268 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/30e4155a58f44fac9415a3af1f68ab5d 2023-08-03 08:59:41,415 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/30e4155a58f44fac9415a3af1f68ab5d as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/30e4155a58f44fac9415a3af1f68ab5d 2023-08-03 08:59:41,419 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/30e4155a58f44fac9415a3af1f68ab5d, entries=20, sequenceid=268, filesize=25.3 K 2023-08-03 08:59:41,420 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~20.53 KB/21020, heapSize ~22.27 KB/22800, currentSize=9.24 KB/9459 for ccb2fa656152c47a5916830b83034f83 in 26ms, sequenceid=268, compaction requested=true 2023-08-03 08:59:41,420 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:41,420 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:59:41,420 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-03 08:59:41,422 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 173433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-03 08:59:41,422 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1912): ccb2fa656152c47a5916830b83034f83/info is initiating minor compaction (all files) 2023-08-03 08:59:41,422 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ccb2fa656152c47a5916830b83034f83/info in TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:59:41,422 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/8e135ad3d4b245febac70c43ae19c61a, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/377a7e100dde469a9695dda6c941d90b, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/30e4155a58f44fac9415a3af1f68ab5d] into tmpdir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp, totalSize=169.4 K 2023-08-03 08:59:41,422 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 8e135ad3d4b245febac70c43ae19c61a, keycount=120, bloomtype=ROW, size=129.0 K, encoding=NONE, compression=NONE, seqNum=231, earliestPutTs=1691053130901 2023-08-03 08:59:41,423 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 377a7e100dde469a9695dda6c941d90b, keycount=10, bloomtype=ROW, size=15.0 K, encoding=NONE, compression=NONE, seqNum=245, earliestPutTs=1691053169326 2023-08-03 08:59:41,423 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 30e4155a58f44fac9415a3af1f68ab5d, keycount=20, bloomtype=ROW, size=25.3 K, encoding=NONE, compression=NONE, seqNum=268, earliestPutTs=1691053171340 2023-08-03 08:59:41,434 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] throttle.PressureAwareThroughputController(145): ccb2fa656152c47a5916830b83034f83#info#compaction#39 average throughput is 75.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-03 08:59:41,446 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/632dc5314528418eae4e9cc90931f2f1 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/632dc5314528418eae4e9cc90931f2f1 2023-08-03 08:59:41,452 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ccb2fa656152c47a5916830b83034f83/info of ccb2fa656152c47a5916830b83034f83 into 632dc5314528418eae4e9cc90931f2f1(size=160.0 K), total size for store is 160.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-03 08:59:41,452 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:41,452 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83., storeName=ccb2fa656152c47a5916830b83034f83/info, priority=13, startTime=1691053181420; duration=0sec 2023-08-03 08:59:41,452 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:59:51,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:51,500 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing ccb2fa656152c47a5916830b83034f83 1/1 column families, dataSize=10.26 KB heapSize=11.27 KB 2023-08-03 08:59:51,515 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=10.26 KB at sequenceid=282 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/edf09f4b31c942c49ce5fee8c482c781 2023-08-03 08:59:51,522 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/edf09f4b31c942c49ce5fee8c482c781 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/edf09f4b31c942c49ce5fee8c482c781 2023-08-03 08:59:51,527 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/edf09f4b31c942c49ce5fee8c482c781, entries=10, sequenceid=282, filesize=15.0 K 2023-08-03 08:59:51,528 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~10.26 KB/10510, heapSize ~11.25 KB/11520, currentSize=1.03 KB/1051 for ccb2fa656152c47a5916830b83034f83 in 28ms, sequenceid=282, compaction requested=false 2023-08-03 08:59:51,528 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:53,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:53,509 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing ccb2fa656152c47a5916830b83034f83 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-03 08:59:53,523 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=293 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/0baa80197d71429d95fa4977c799bad3 2023-08-03 08:59:53,529 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/0baa80197d71429d95fa4977c799bad3 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/0baa80197d71429d95fa4977c799bad3 2023-08-03 08:59:53,535 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/0baa80197d71429d95fa4977c799bad3, entries=8, sequenceid=293, filesize=13.0 K 2023-08-03 08:59:53,536 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for ccb2fa656152c47a5916830b83034f83 in 27ms, sequenceid=293, compaction requested=true 2023-08-03 08:59:53,536 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:53,536 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:59:53,536 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-03 08:59:53,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45367] regionserver.HRegion(9158): Flush requested on ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:53,536 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing ccb2fa656152c47a5916830b83034f83 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-03 08:59:53,537 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 192563 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-03 08:59:53,538 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1912): ccb2fa656152c47a5916830b83034f83/info is initiating minor compaction (all files) 2023-08-03 08:59:53,538 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ccb2fa656152c47a5916830b83034f83/info in TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:59:53,538 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/632dc5314528418eae4e9cc90931f2f1, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/edf09f4b31c942c49ce5fee8c482c781, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/0baa80197d71429d95fa4977c799bad3] into tmpdir=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp, totalSize=188.0 K 2023-08-03 08:59:53,541 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 632dc5314528418eae4e9cc90931f2f1, keycount=150, bloomtype=ROW, size=160.0 K, encoding=NONE, compression=NONE, seqNum=268, earliestPutTs=1691053130901 2023-08-03 08:59:53,542 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting edf09f4b31c942c49ce5fee8c482c781, keycount=10, bloomtype=ROW, size=15.0 K, encoding=NONE, compression=NONE, seqNum=282, earliestPutTs=1691053181394 2023-08-03 08:59:53,543 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] compactions.Compactor(207): Compacting 0baa80197d71429d95fa4977c799bad3, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=293, earliestPutTs=1691053191501 2023-08-03 08:59:53,561 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=318 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/ab90cd7e305549118ca18509ee884fdf 2023-08-03 08:59:53,566 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] throttle.PressureAwareThroughputController(145): ccb2fa656152c47a5916830b83034f83#info#compaction#43 average throughput is 56.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-03 08:59:53,567 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/ab90cd7e305549118ca18509ee884fdf as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/ab90cd7e305549118ca18509ee884fdf 2023-08-03 08:59:53,575 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/ab90cd7e305549118ca18509ee884fdf, entries=22, sequenceid=318, filesize=27.4 K 2023-08-03 08:59:53,577 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=3.08 KB/3153 for ccb2fa656152c47a5916830b83034f83 in 41ms, sequenceid=318, compaction requested=false 2023-08-03 08:59:53,577 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:53,586 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/93be8ed41b164de084fe09b0f1813d4e as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/93be8ed41b164de084fe09b0f1813d4e 2023-08-03 08:59:53,592 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ccb2fa656152c47a5916830b83034f83/info of ccb2fa656152c47a5916830b83034f83 into 93be8ed41b164de084fe09b0f1813d4e(size=178.7 K), total size for store is 206.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-03 08:59:53,593 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:53,593 INFO [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83., storeName=ccb2fa656152c47a5916830b83034f83/info, priority=13, startTime=1691053193536; duration=0sec 2023-08-03 08:59:53,593 DEBUG [RS:0;jenkins-hbase4:45367-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-03 08:59:55,540 INFO [Listener at localhost/37831] wal.AbstractTestLogRolling(188): after writing there are 0 log files 2023-08-03 08:59:55,557 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45737,DS-b4ef9096-3416-4fdc-ac73-8952e5832454,DISK] 2023-08-03 08:59:55,557 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41265,DS-c8c52b92-99f1-4b03-a5db-5a77ae4f2bbe,DISK] 2023-08-03 08:59:55,561 INFO [Listener at localhost/37831] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053107903 with entries=308, filesize=300.35 KB; new WAL /user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053195541 2023-08-03 08:59:55,562 DEBUG [Listener at localhost/37831] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45737,DS-b4ef9096-3416-4fdc-ac73-8952e5832454,DISK], DatanodeInfoWithStorage[127.0.0.1:41265,DS-c8c52b92-99f1-4b03-a5db-5a77ae4f2bbe,DISK]] 2023-08-03 08:59:55,563 DEBUG [Listener at localhost/37831] wal.AbstractFSWAL(716): hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053107903 is not closed yet, will try archiving it next time 2023-08-03 08:59:55,566 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053107903 not finished, retry = 0 2023-08-03 08:59:55,569 INFO [Listener at localhost/37831] regionserver.HRegion(2745): Flushing ccb2fa656152c47a5916830b83034f83 1/1 column families, dataSize=3.08 KB heapSize=3.55 KB 2023-08-03 08:59:55,578 INFO [Listener at localhost/37831] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.08 KB at sequenceid=325 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/c6c8417e8c17412d958298b7b4032b12 2023-08-03 08:59:55,583 DEBUG [Listener at localhost/37831] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/.tmp/info/c6c8417e8c17412d958298b7b4032b12 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/c6c8417e8c17412d958298b7b4032b12 2023-08-03 08:59:55,588 INFO [Listener at localhost/37831] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/c6c8417e8c17412d958298b7b4032b12, entries=3, sequenceid=325, filesize=7.8 K 2023-08-03 08:59:55,589 INFO [Listener at localhost/37831] regionserver.HRegion(2948): Finished flush of dataSize ~3.08 KB/3153, heapSize ~3.54 KB/3624, currentSize=0 B/0 for ccb2fa656152c47a5916830b83034f83 in 20ms, sequenceid=325, compaction requested=true 2023-08-03 08:59:55,589 DEBUG [Listener at localhost/37831] regionserver.HRegion(2446): Flush status journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:55,589 INFO [Listener at localhost/37831] regionserver.HRegion(2745): Flushing 90d26fc9af1c87f603bc8a6611d4bc91 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-03 08:59:55,601 INFO [Listener at localhost/37831] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91/.tmp/info/ffb0072d6a6248478d770ac5d7f1e5ae 2023-08-03 08:59:55,606 DEBUG [Listener at localhost/37831] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91/.tmp/info/ffb0072d6a6248478d770ac5d7f1e5ae as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91/info/ffb0072d6a6248478d770ac5d7f1e5ae 2023-08-03 08:59:55,611 INFO [Listener at localhost/37831] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91/info/ffb0072d6a6248478d770ac5d7f1e5ae, entries=2, sequenceid=6, filesize=4.8 K 2023-08-03 08:59:55,612 INFO [Listener at localhost/37831] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 90d26fc9af1c87f603bc8a6611d4bc91 in 23ms, sequenceid=6, compaction requested=false 2023-08-03 08:59:55,613 DEBUG [Listener at localhost/37831] regionserver.HRegion(2446): Flush status journal for 90d26fc9af1c87f603bc8a6611d4bc91: 2023-08-03 08:59:55,613 INFO [Listener at localhost/37831] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.26 KB heapSize=4.19 KB 2023-08-03 08:59:55,622 INFO [Listener at localhost/37831] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.26 KB at sequenceid=24 (bloomFilter=false), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/.tmp/info/5814a1f457d641a6a74d75d9f2896222 2023-08-03 08:59:55,628 DEBUG [Listener at localhost/37831] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/.tmp/info/5814a1f457d641a6a74d75d9f2896222 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/info/5814a1f457d641a6a74d75d9f2896222 2023-08-03 08:59:55,632 INFO [Listener at localhost/37831] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/info/5814a1f457d641a6a74d75d9f2896222, entries=16, sequenceid=24, filesize=7.0 K 2023-08-03 08:59:55,633 INFO [Listener at localhost/37831] regionserver.HRegion(2948): Finished flush of dataSize ~2.26 KB/2312, heapSize ~3.67 KB/3760, currentSize=0 B/0 for 1588230740 in 20ms, sequenceid=24, compaction requested=false 2023-08-03 08:59:55,633 DEBUG [Listener at localhost/37831] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-08-03 08:59:55,633 DEBUG [Listener at localhost/37831] regionserver.HRegion(2446): Flush status journal for a3a3fc9d114d77b9d286bc2f565feb6f: 2023-08-03 08:59:55,646 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41265,DS-c8c52b92-99f1-4b03-a5db-5a77ae4f2bbe,DISK] 2023-08-03 08:59:55,646 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45737,DS-b4ef9096-3416-4fdc-ac73-8952e5832454,DISK] 2023-08-03 08:59:55,648 INFO [Listener at localhost/37831] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053195541 with entries=4, filesize=1.22 KB; new WAL /user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053195633 2023-08-03 08:59:55,648 DEBUG [Listener at localhost/37831] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41265,DS-c8c52b92-99f1-4b03-a5db-5a77ae4f2bbe,DISK], DatanodeInfoWithStorage[127.0.0.1:45737,DS-b4ef9096-3416-4fdc-ac73-8952e5832454,DISK]] 2023-08-03 08:59:55,648 DEBUG [Listener at localhost/37831] wal.AbstractFSWAL(716): hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053107903 is not closed yet, will try archiving it next time 2023-08-03 08:59:55,648 DEBUG [Listener at localhost/37831] wal.AbstractFSWAL(716): hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053195541 is not closed yet, will try archiving it next time 2023-08-03 08:59:55,649 INFO [Listener at localhost/37831] hbase.Waiter(180): Waiting up to [5,000] milli-secs(wait.for.ratio=[1]) 2023-08-03 08:59:55,650 DEBUG [Close-WAL-Writer-1] wal.AbstractFSWAL(716): hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053107903 is not closed yet, will try archiving it next time 2023-08-03 08:59:55,651 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053195541 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/oldWALs/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053195541 2023-08-03 08:59:55,666 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/WALs/jenkins-hbase4.apache.org,45367,1691053107478/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053107903 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/oldWALs/jenkins-hbase4.apache.org%2C45367%2C1691053107478.1691053107903 2023-08-03 08:59:55,749 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-03 08:59:55,749 INFO [Listener at localhost/37831] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-03 08:59:55,749 DEBUG [Listener at localhost/37831] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2630ef71 to 127.0.0.1:57170 2023-08-03 08:59:55,749 DEBUG [Listener at localhost/37831] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:59:55,750 DEBUG [Listener at localhost/37831] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-03 08:59:55,750 DEBUG [Listener at localhost/37831] util.JVMClusterUtil(257): Found active master hash=1998326621, stopped=false 2023-08-03 08:59:55,750 INFO [Listener at localhost/37831] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36663,1691053107434 2023-08-03 08:59:55,751 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-03 08:59:55,751 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): regionserver:45367-0x101ca0d2bdb0001, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-03 08:59:55,751 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:55,751 INFO [Listener at localhost/37831] procedure2.ProcedureExecutor(629): Stopping 2023-08-03 08:59:55,752 DEBUG [Listener at localhost/37831] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f426bc1 to 127.0.0.1:57170 2023-08-03 08:59:55,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45367-0x101ca0d2bdb0001, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:59:55,752 DEBUG [Listener at localhost/37831] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:59:55,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:59:55,753 INFO [Listener at localhost/37831] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45367,1691053107478' ***** 2023-08-03 08:59:55,753 INFO [Listener at localhost/37831] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-03 08:59:55,753 INFO [RS:0;jenkins-hbase4:45367] regionserver.HeapMemoryManager(220): Stopping 2023-08-03 08:59:55,753 INFO [RS:0;jenkins-hbase4:45367] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-03 08:59:55,753 INFO [RS:0;jenkins-hbase4:45367] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-03 08:59:55,753 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-03 08:59:55,753 INFO [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(3305): Received CLOSE for ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:55,754 INFO [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(3305): Received CLOSE for 90d26fc9af1c87f603bc8a6611d4bc91 2023-08-03 08:59:55,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ccb2fa656152c47a5916830b83034f83, disabling compactions & flushes 2023-08-03 08:59:55,754 INFO [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(3305): Received CLOSE for a3a3fc9d114d77b9d286bc2f565feb6f 2023-08-03 08:59:55,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:59:55,754 INFO [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:59:55,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:59:55,754 DEBUG [RS:0;jenkins-hbase4:45367] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18bf9318 to 127.0.0.1:57170 2023-08-03 08:59:55,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. after waiting 0 ms 2023-08-03 08:59:55,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:59:55,754 DEBUG [RS:0;jenkins-hbase4:45367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:59:55,754 INFO [RS:0;jenkins-hbase4:45367] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-03 08:59:55,754 INFO [RS:0;jenkins-hbase4:45367] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-03 08:59:55,754 INFO [RS:0;jenkins-hbase4:45367] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-03 08:59:55,754 INFO [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-03 08:59:55,755 INFO [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-08-03 08:59:55,755 DEBUG [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(1478): Online Regions={ccb2fa656152c47a5916830b83034f83=TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83., 90d26fc9af1c87f603bc8a6611d4bc91=hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91., 1588230740=hbase:meta,,1.1588230740, a3a3fc9d114d77b9d286bc2f565feb6f=TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f.} 2023-08-03 08:59:55,756 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-03 08:59:55,758 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-03 08:59:55,758 DEBUG [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(1504): Waiting on 1588230740, 90d26fc9af1c87f603bc8a6611d4bc91, a3a3fc9d114d77b9d286bc2f565feb6f, ccb2fa656152c47a5916830b83034f83 2023-08-03 08:59:55,759 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-03 08:59:55,762 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-03 08:59:55,763 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-03 08:59:55,771 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/bbfa646ef13a422083f243d929842b72.0b793ca6f32a0f2dc3bf0c4bab161e52->hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/bbfa646ef13a422083f243d929842b72-top, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-59dd98ff254c49a7b1382699f8e8937f, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/adeb3873a99048ddafaaeb4c6c468cdc, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-ee60df6d51674b79a8dad9f15b42cd03, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/08caaa14c3ec47dcbe9a949325d082a6, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/e0d38183f639479eab0b0746db34313f, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/9ed11c93713b4d85b1980b6e5acafbb4, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/a7ca457cbb40441482b0c3637803a6c9, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/9b3768eb5bb54a0dbff28db3c2b159d0, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/5c66b955b5e84d95a3a567f5e827d510, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/6b1cc2a56fb140c0944111fdaab77f8e, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/8e135ad3d4b245febac70c43ae19c61a, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/ea7761df9b5646209e38e97fe7aa2514, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/377a7e100dde469a9695dda6c941d90b, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/632dc5314528418eae4e9cc90931f2f1, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/30e4155a58f44fac9415a3af1f68ab5d, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/edf09f4b31c942c49ce5fee8c482c781, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/0baa80197d71429d95fa4977c799bad3] to archive 2023-08-03 08:59:55,772 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-03 08:59:55,774 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/bbfa646ef13a422083f243d929842b72.0b793ca6f32a0f2dc3bf0c4bab161e52 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/bbfa646ef13a422083f243d929842b72.0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:59:55,775 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/meta/1588230740/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-08-03 08:59:55,776 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-03 08:59:55,776 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-03 08:59:55,777 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-03 08:59:55,777 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-03 08:59:55,777 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-59dd98ff254c49a7b1382699f8e8937f to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-59dd98ff254c49a7b1382699f8e8937f 2023-08-03 08:59:55,778 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/adeb3873a99048ddafaaeb4c6c468cdc to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/adeb3873a99048ddafaaeb4c6c468cdc 2023-08-03 08:59:55,779 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-03 08:59:55,780 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-03 08:59:55,780 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-03 08:59:55,781 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-ee60df6d51674b79a8dad9f15b42cd03 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/TestLogRolling-testLogRolling=0b793ca6f32a0f2dc3bf0c4bab161e52-ee60df6d51674b79a8dad9f15b42cd03 2023-08-03 08:59:55,782 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/08caaa14c3ec47dcbe9a949325d082a6 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/08caaa14c3ec47dcbe9a949325d082a6 2023-08-03 08:59:55,783 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/e0d38183f639479eab0b0746db34313f to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/e0d38183f639479eab0b0746db34313f 2023-08-03 08:59:55,784 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/9ed11c93713b4d85b1980b6e5acafbb4 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/9ed11c93713b4d85b1980b6e5acafbb4 2023-08-03 08:59:55,785 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/a7ca457cbb40441482b0c3637803a6c9 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/a7ca457cbb40441482b0c3637803a6c9 2023-08-03 08:59:55,786 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/9b3768eb5bb54a0dbff28db3c2b159d0 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/9b3768eb5bb54a0dbff28db3c2b159d0 2023-08-03 08:59:55,787 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/5c66b955b5e84d95a3a567f5e827d510 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/5c66b955b5e84d95a3a567f5e827d510 2023-08-03 08:59:55,788 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/6b1cc2a56fb140c0944111fdaab77f8e to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/6b1cc2a56fb140c0944111fdaab77f8e 2023-08-03 08:59:55,789 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/8e135ad3d4b245febac70c43ae19c61a to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/8e135ad3d4b245febac70c43ae19c61a 2023-08-03 08:59:55,790 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/ea7761df9b5646209e38e97fe7aa2514 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/ea7761df9b5646209e38e97fe7aa2514 2023-08-03 08:59:55,791 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/377a7e100dde469a9695dda6c941d90b to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/377a7e100dde469a9695dda6c941d90b 2023-08-03 08:59:55,793 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/632dc5314528418eae4e9cc90931f2f1 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/632dc5314528418eae4e9cc90931f2f1 2023-08-03 08:59:55,794 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/30e4155a58f44fac9415a3af1f68ab5d to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/30e4155a58f44fac9415a3af1f68ab5d 2023-08-03 08:59:55,795 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/edf09f4b31c942c49ce5fee8c482c781 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/edf09f4b31c942c49ce5fee8c482c781 2023-08-03 08:59:55,796 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/0baa80197d71429d95fa4977c799bad3 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/info/0baa80197d71429d95fa4977c799bad3 2023-08-03 08:59:55,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/ccb2fa656152c47a5916830b83034f83/recovered.edits/328.seqid, newMaxSeqId=328, maxSeqId=123 2023-08-03 08:59:55,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:59:55,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ccb2fa656152c47a5916830b83034f83: 2023-08-03 08:59:55,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,row0064,1691053133032.ccb2fa656152c47a5916830b83034f83. 2023-08-03 08:59:55,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 90d26fc9af1c87f603bc8a6611d4bc91, disabling compactions & flushes 2023-08-03 08:59:55,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. 2023-08-03 08:59:55,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. 2023-08-03 08:59:55,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. after waiting 0 ms 2023-08-03 08:59:55,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. 2023-08-03 08:59:55,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/hbase/namespace/90d26fc9af1c87f603bc8a6611d4bc91/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-03 08:59:55,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. 2023-08-03 08:59:55,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 90d26fc9af1c87f603bc8a6611d4bc91: 2023-08-03 08:59:55,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1691053108154.90d26fc9af1c87f603bc8a6611d4bc91. 2023-08-03 08:59:55,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a3a3fc9d114d77b9d286bc2f565feb6f, disabling compactions & flushes 2023-08-03 08:59:55,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f. 2023-08-03 08:59:55,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f. 2023-08-03 08:59:55,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f. after waiting 0 ms 2023-08-03 08:59:55,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f. 2023-08-03 08:59:55,807 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f/info/bbfa646ef13a422083f243d929842b72.0b793ca6f32a0f2dc3bf0c4bab161e52->hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/0b793ca6f32a0f2dc3bf0c4bab161e52/info/bbfa646ef13a422083f243d929842b72-bottom] to archive 2023-08-03 08:59:55,808 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-03 08:59:55,809 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f/info/bbfa646ef13a422083f243d929842b72.0b793ca6f32a0f2dc3bf0c4bab161e52 to hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/archive/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f/info/bbfa646ef13a422083f243d929842b72.0b793ca6f32a0f2dc3bf0c4bab161e52 2023-08-03 08:59:55,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/data/default/TestLogRolling-testLogRolling/a3a3fc9d114d77b9d286bc2f565feb6f/recovered.edits/128.seqid, newMaxSeqId=128, maxSeqId=123 2023-08-03 08:59:55,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f. 2023-08-03 08:59:55,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a3a3fc9d114d77b9d286bc2f565feb6f: 2023-08-03 08:59:55,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,,1691053133032.a3a3fc9d114d77b9d286bc2f565feb6f. 2023-08-03 08:59:55,961 INFO [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45367,1691053107478; all regions closed. 2023-08-03 08:59:55,966 DEBUG [RS:0;jenkins-hbase4:45367] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/oldWALs 2023-08-03 08:59:55,966 INFO [RS:0;jenkins-hbase4:45367] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45367%2C1691053107478.meta:.meta(num 1691053108095) 2023-08-03 08:59:55,971 DEBUG [RS:0;jenkins-hbase4:45367] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/oldWALs 2023-08-03 08:59:55,971 INFO [RS:0;jenkins-hbase4:45367] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45367%2C1691053107478:(num 1691053195633) 2023-08-03 08:59:55,971 DEBUG [RS:0;jenkins-hbase4:45367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:59:55,971 INFO [RS:0;jenkins-hbase4:45367] regionserver.LeaseManager(133): Closed leases 2023-08-03 08:59:55,971 INFO [RS:0;jenkins-hbase4:45367] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-03 08:59:55,972 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-03 08:59:55,972 INFO [RS:0;jenkins-hbase4:45367] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45367 2023-08-03 08:59:55,975 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): regionserver:45367-0x101ca0d2bdb0001, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45367,1691053107478 2023-08-03 08:59:55,975 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-03 08:59:55,975 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): regionserver:45367-0x101ca0d2bdb0001, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-03 08:59:55,976 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45367,1691053107478] 2023-08-03 08:59:55,976 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45367,1691053107478; numProcessing=1 2023-08-03 08:59:55,978 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45367,1691053107478 already deleted, retry=false 2023-08-03 08:59:55,978 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45367,1691053107478 expired; onlineServers=0 2023-08-03 08:59:55,978 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36663,1691053107434' ***** 2023-08-03 08:59:55,978 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-03 08:59:55,978 DEBUG [M:0;jenkins-hbase4:36663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73238166, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-03 08:59:55,978 INFO [M:0;jenkins-hbase4:36663] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36663,1691053107434 2023-08-03 08:59:55,978 INFO [M:0;jenkins-hbase4:36663] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36663,1691053107434; all regions closed. 2023-08-03 08:59:55,979 DEBUG [M:0;jenkins-hbase4:36663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:59:55,979 DEBUG [M:0;jenkins-hbase4:36663] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-03 08:59:55,979 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-03 08:59:55,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691053107719] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691053107719,5,FailOnTimeoutGroup] 2023-08-03 08:59:55,979 DEBUG [M:0;jenkins-hbase4:36663] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-03 08:59:55,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691053107719] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691053107719,5,FailOnTimeoutGroup] 2023-08-03 08:59:55,979 INFO [M:0;jenkins-hbase4:36663] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-03 08:59:55,980 INFO [M:0;jenkins-hbase4:36663] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-03 08:59:55,980 INFO [M:0;jenkins-hbase4:36663] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-03 08:59:55,980 DEBUG [M:0;jenkins-hbase4:36663] master.HMaster(1512): Stopping service threads 2023-08-03 08:59:55,980 INFO [M:0;jenkins-hbase4:36663] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-03 08:59:55,980 ERROR [M:0;jenkins-hbase4:36663] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-08-03 08:59:55,980 INFO [M:0;jenkins-hbase4:36663] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-03 08:59:55,980 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-03 08:59:55,981 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-03 08:59:55,981 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:55,981 DEBUG [M:0;jenkins-hbase4:36663] zookeeper.ZKUtil(398): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-03 08:59:55,981 WARN [M:0;jenkins-hbase4:36663] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-03 08:59:55,981 INFO [M:0;jenkins-hbase4:36663] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-03 08:59:55,981 INFO [M:0;jenkins-hbase4:36663] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-03 08:59:55,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-03 08:59:55,982 DEBUG [M:0;jenkins-hbase4:36663] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-03 08:59:55,982 INFO [M:0;jenkins-hbase4:36663] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:59:55,982 DEBUG [M:0;jenkins-hbase4:36663] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:59:55,982 DEBUG [M:0;jenkins-hbase4:36663] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-03 08:59:55,982 DEBUG [M:0;jenkins-hbase4:36663] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:59:55,982 INFO [M:0;jenkins-hbase4:36663] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=64.70 KB heapSize=78.42 KB 2023-08-03 08:59:55,995 INFO [M:0;jenkins-hbase4:36663] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64.70 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f5b6ddf7f7f347059b8fb99d25dda824 2023-08-03 08:59:55,999 INFO [M:0;jenkins-hbase4:36663] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f5b6ddf7f7f347059b8fb99d25dda824 2023-08-03 08:59:56,000 DEBUG [M:0;jenkins-hbase4:36663] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f5b6ddf7f7f347059b8fb99d25dda824 as hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f5b6ddf7f7f347059b8fb99d25dda824 2023-08-03 08:59:56,005 INFO [M:0;jenkins-hbase4:36663] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f5b6ddf7f7f347059b8fb99d25dda824 2023-08-03 08:59:56,005 INFO [M:0;jenkins-hbase4:36663] regionserver.HStore(1080): Added hdfs://localhost:37021/user/jenkins/test-data/0253c279-3763-e04f-80c7-4c354135f81c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f5b6ddf7f7f347059b8fb99d25dda824, entries=18, sequenceid=160, filesize=6.9 K 2023-08-03 08:59:56,006 INFO [M:0;jenkins-hbase4:36663] regionserver.HRegion(2948): Finished flush of dataSize ~64.70 KB/66256, heapSize ~78.41 KB/80288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=160, compaction requested=false 2023-08-03 08:59:56,007 INFO [M:0;jenkins-hbase4:36663] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:59:56,007 DEBUG [M:0;jenkins-hbase4:36663] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-03 08:59:56,010 INFO [M:0;jenkins-hbase4:36663] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-03 08:59:56,010 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-03 08:59:56,010 INFO [M:0;jenkins-hbase4:36663] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36663 2023-08-03 08:59:56,013 DEBUG [M:0;jenkins-hbase4:36663] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36663,1691053107434 already deleted, retry=false 2023-08-03 08:59:56,077 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): regionserver:45367-0x101ca0d2bdb0001, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:59:56,077 INFO [RS:0;jenkins-hbase4:45367] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45367,1691053107478; zookeeper connection closed. 2023-08-03 08:59:56,077 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): regionserver:45367-0x101ca0d2bdb0001, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:59:56,078 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7cdd0e5a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7cdd0e5a 2023-08-03 08:59:56,078 INFO [Listener at localhost/37831] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-03 08:59:56,177 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:59:56,177 INFO [M:0;jenkins-hbase4:36663] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36663,1691053107434; zookeeper connection closed. 2023-08-03 08:59:56,177 DEBUG [Listener at localhost/37831-EventThread] zookeeper.ZKWatcher(600): master:36663-0x101ca0d2bdb0000, quorum=127.0.0.1:57170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:59:56,178 WARN [Listener at localhost/37831] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-03 08:59:56,182 INFO [Listener at localhost/37831] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:59:56,288 WARN [BP-377584572-172.31.14.131-1691053106695 heartbeating to localhost/127.0.0.1:37021] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-03 08:59:56,288 WARN [BP-377584572-172.31.14.131-1691053106695 heartbeating to localhost/127.0.0.1:37021] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-377584572-172.31.14.131-1691053106695 (Datanode Uuid 29e0ced5-6ba0-481a-8e26-b39ed2be4810) service to localhost/127.0.0.1:37021 2023-08-03 08:59:56,289 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/cluster_d03f793a-8007-d2fd-107a-eeef7c4fbe9e/dfs/data/data3/current/BP-377584572-172.31.14.131-1691053106695] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:59:56,289 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/cluster_d03f793a-8007-d2fd-107a-eeef7c4fbe9e/dfs/data/data4/current/BP-377584572-172.31.14.131-1691053106695] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:59:56,290 WARN [Listener at localhost/37831] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-03 08:59:56,293 INFO [Listener at localhost/37831] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:59:56,398 WARN [BP-377584572-172.31.14.131-1691053106695 heartbeating to localhost/127.0.0.1:37021] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-03 08:59:56,399 WARN [BP-377584572-172.31.14.131-1691053106695 heartbeating to localhost/127.0.0.1:37021] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-377584572-172.31.14.131-1691053106695 (Datanode Uuid 93c24eb0-55b1-4c39-bcf5-38fb5e42125c) service to localhost/127.0.0.1:37021 2023-08-03 08:59:56,399 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/cluster_d03f793a-8007-d2fd-107a-eeef7c4fbe9e/dfs/data/data1/current/BP-377584572-172.31.14.131-1691053106695] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:59:56,400 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/cluster_d03f793a-8007-d2fd-107a-eeef7c4fbe9e/dfs/data/data2/current/BP-377584572-172.31.14.131-1691053106695] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:59:56,410 INFO [Listener at localhost/37831] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:59:56,527 INFO [Listener at localhost/37831] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-03 08:59:56,560 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-03 08:59:56,570 INFO [Listener at localhost/37831] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=75 (was 64) - Thread LEAK? -, OpenFileDescriptor=471 (was 442) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 82) - SystemLoadAverage LEAK? -, ProcessCount=177 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=989 (was 977) - AvailableMemoryMB LEAK? - 2023-08-03 08:59:56,578 INFO [Listener at localhost/37831] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=76, OpenFileDescriptor=471, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=177, AvailableMemoryMB=988 2023-08-03 08:59:56,579 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-03 08:59:56,579 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/hadoop.log.dir so I do NOT create it in target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e 2023-08-03 08:59:56,579 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d9d289c-76da-23dc-f20b-7b13133c4713/hadoop.tmp.dir so I do NOT create it in target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e 2023-08-03 08:59:56,579 INFO [Listener at localhost/37831] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/cluster_eedacf70-02a4-f29e-b5c2-4dc6932c7cb8, deleteOnExit=true 2023-08-03 08:59:56,579 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-03 08:59:56,579 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/test.cache.data in system properties and HBase conf 2023-08-03 08:59:56,579 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/hadoop.tmp.dir in system properties and HBase conf 2023-08-03 08:59:56,579 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/hadoop.log.dir in system properties and HBase conf 2023-08-03 08:59:56,579 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-03 08:59:56,580 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-03 08:59:56,580 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-03 08:59:56,580 DEBUG [Listener at localhost/37831] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-03 08:59:56,580 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-03 08:59:56,580 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-03 08:59:56,580 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-03 08:59:56,580 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-03 08:59:56,580 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-03 08:59:56,581 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-03 08:59:56,581 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-03 08:59:56,581 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-03 08:59:56,581 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-03 08:59:56,581 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/nfs.dump.dir in system properties and HBase conf 2023-08-03 08:59:56,581 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/java.io.tmpdir in system properties and HBase conf 2023-08-03 08:59:56,581 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-03 08:59:56,581 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-03 08:59:56,581 INFO [Listener at localhost/37831] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-03 08:59:56,585 WARN [Listener at localhost/37831] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-03 08:59:56,585 WARN [Listener at localhost/37831] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-03 08:59:56,624 WARN [Listener at localhost/37831] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:59:56,627 INFO [Listener at localhost/37831] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:59:56,631 INFO [Listener at localhost/37831] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/java.io.tmpdir/Jetty_localhost_45087_hdfs____x2s69k/webapp 2023-08-03 08:59:56,723 INFO [Listener at localhost/37831] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45087 2023-08-03 08:59:56,727 WARN [Listener at localhost/37831] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-03 08:59:56,728 WARN [Listener at localhost/37831] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-03 08:59:56,771 WARN [Listener at localhost/33377] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:59:56,783 WARN [Listener at localhost/33377] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-03 08:59:56,786 WARN [Listener at localhost/33377] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:59:56,788 INFO [Listener at localhost/33377] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:59:56,792 INFO [Listener at localhost/33377] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/java.io.tmpdir/Jetty_localhost_32973_datanode____.gvuryb/webapp 2023-08-03 08:59:56,883 INFO [Listener at localhost/33377] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32973 2023-08-03 08:59:56,890 WARN [Listener at localhost/43355] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:59:56,903 WARN [Listener at localhost/43355] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-03 08:59:56,905 WARN [Listener at localhost/43355] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-03 08:59:56,906 INFO [Listener at localhost/43355] log.Slf4jLog(67): jetty-6.1.26 2023-08-03 08:59:56,912 INFO [Listener at localhost/43355] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/java.io.tmpdir/Jetty_localhost_36181_datanode____zco8pa/webapp 2023-08-03 08:59:56,995 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x70c201d4becf649a: Processing first storage report for DS-ee8abfb2-d3d3-44c5-b6b1-a6e91e14044b from datanode 6238f14d-d726-4eab-8c33-ff9c9048a62b 2023-08-03 08:59:56,996 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x70c201d4becf649a: from storage DS-ee8abfb2-d3d3-44c5-b6b1-a6e91e14044b node DatanodeRegistration(127.0.0.1:39021, datanodeUuid=6238f14d-d726-4eab-8c33-ff9c9048a62b, infoPort=35989, infoSecurePort=0, ipcPort=43355, storageInfo=lv=-57;cid=testClusterID;nsid=388386934;c=1691053196588), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:59:56,996 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x70c201d4becf649a: Processing first storage report for DS-c266a4c4-c2bf-410d-8346-6a0b3ccd0b4f from datanode 6238f14d-d726-4eab-8c33-ff9c9048a62b 2023-08-03 08:59:56,996 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x70c201d4becf649a: from storage DS-c266a4c4-c2bf-410d-8346-6a0b3ccd0b4f node DatanodeRegistration(127.0.0.1:39021, datanodeUuid=6238f14d-d726-4eab-8c33-ff9c9048a62b, infoPort=35989, infoSecurePort=0, ipcPort=43355, storageInfo=lv=-57;cid=testClusterID;nsid=388386934;c=1691053196588), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:59:57,009 INFO [Listener at localhost/43355] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36181 2023-08-03 08:59:57,015 WARN [Listener at localhost/37075] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-03 08:59:57,111 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x20120f119d77000: Processing first storage report for DS-e4ea5711-fe0b-4480-93c9-47a91b8d70a2 from datanode edb875dd-4024-4923-8ed5-d21b2f1c63a3 2023-08-03 08:59:57,111 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x20120f119d77000: from storage DS-e4ea5711-fe0b-4480-93c9-47a91b8d70a2 node DatanodeRegistration(127.0.0.1:39427, datanodeUuid=edb875dd-4024-4923-8ed5-d21b2f1c63a3, infoPort=44191, infoSecurePort=0, ipcPort=37075, storageInfo=lv=-57;cid=testClusterID;nsid=388386934;c=1691053196588), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:59:57,111 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x20120f119d77000: Processing first storage report for DS-13f0e66c-dbf5-4ada-ac65-9d4b499fb232 from datanode edb875dd-4024-4923-8ed5-d21b2f1c63a3 2023-08-03 08:59:57,111 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x20120f119d77000: from storage DS-13f0e66c-dbf5-4ada-ac65-9d4b499fb232 node DatanodeRegistration(127.0.0.1:39427, datanodeUuid=edb875dd-4024-4923-8ed5-d21b2f1c63a3, infoPort=44191, infoSecurePort=0, ipcPort=37075, storageInfo=lv=-57;cid=testClusterID;nsid=388386934;c=1691053196588), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-03 08:59:57,120 DEBUG [Listener at localhost/37075] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e 2023-08-03 08:59:57,123 INFO [Listener at localhost/37075] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/cluster_eedacf70-02a4-f29e-b5c2-4dc6932c7cb8/zookeeper_0, clientPort=59414, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/cluster_eedacf70-02a4-f29e-b5c2-4dc6932c7cb8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/cluster_eedacf70-02a4-f29e-b5c2-4dc6932c7cb8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-03 08:59:57,124 INFO [Listener at localhost/37075] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59414 2023-08-03 08:59:57,124 INFO [Listener at localhost/37075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:59:57,125 INFO [Listener at localhost/37075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:59:57,139 INFO [Listener at localhost/37075] util.FSUtils(471): Created version file at hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45 with version=8 2023-08-03 08:59:57,139 INFO [Listener at localhost/37075] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:36349/user/jenkins/test-data/2072f3ca-9d28-dced-7668-28e77ae7a65e/hbase-staging 2023-08-03 08:59:57,142 INFO [Listener at localhost/37075] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-03 08:59:57,142 INFO [Listener at localhost/37075] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:59:57,142 INFO [Listener at localhost/37075] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-03 08:59:57,142 INFO [Listener at localhost/37075] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-03 08:59:57,142 INFO [Listener at localhost/37075] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:59:57,142 INFO [Listener at localhost/37075] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-03 08:59:57,143 INFO [Listener at localhost/37075] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-03 08:59:57,144 INFO [Listener at localhost/37075] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42183 2023-08-03 08:59:57,144 INFO [Listener at localhost/37075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:59:57,145 INFO [Listener at localhost/37075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:59:57,146 INFO [Listener at localhost/37075] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42183 connecting to ZooKeeper ensemble=127.0.0.1:59414 2023-08-03 08:59:57,154 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:421830x0, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-03 08:59:57,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42183-0x101ca0e8a450000 connected 2023-08-03 08:59:57,170 DEBUG [Listener at localhost/37075] zookeeper.ZKUtil(164): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-03 08:59:57,170 DEBUG [Listener at localhost/37075] zookeeper.ZKUtil(164): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:59:57,171 DEBUG [Listener at localhost/37075] zookeeper.ZKUtil(164): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-03 08:59:57,171 DEBUG [Listener at localhost/37075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42183 2023-08-03 08:59:57,171 DEBUG [Listener at localhost/37075] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42183 2023-08-03 08:59:57,172 DEBUG [Listener at localhost/37075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42183 2023-08-03 08:59:57,172 DEBUG [Listener at localhost/37075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42183 2023-08-03 08:59:57,172 DEBUG [Listener at localhost/37075] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42183 2023-08-03 08:59:57,172 INFO [Listener at localhost/37075] master.HMaster(444): hbase.rootdir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45, hbase.cluster.distributed=false 2023-08-03 08:59:57,185 INFO [Listener at localhost/37075] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-03 08:59:57,185 INFO [Listener at localhost/37075] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:59:57,185 INFO [Listener at localhost/37075] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-03 08:59:57,185 INFO [Listener at localhost/37075] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-03 08:59:57,185 INFO [Listener at localhost/37075] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-03 08:59:57,185 INFO [Listener at localhost/37075] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-03 08:59:57,185 INFO [Listener at localhost/37075] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-03 08:59:57,187 INFO [Listener at localhost/37075] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37979 2023-08-03 08:59:57,187 INFO [Listener at localhost/37075] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-03 08:59:57,190 DEBUG [Listener at localhost/37075] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-03 08:59:57,191 INFO [Listener at localhost/37075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:59:57,192 INFO [Listener at localhost/37075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:59:57,193 INFO [Listener at localhost/37075] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37979 connecting to ZooKeeper ensemble=127.0.0.1:59414 2023-08-03 08:59:57,200 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): regionserver:379790x0, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-03 08:59:57,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37979-0x101ca0e8a450001 connected 2023-08-03 08:59:57,201 DEBUG [Listener at localhost/37075] zookeeper.ZKUtil(164): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-03 08:59:57,202 DEBUG [Listener at localhost/37075] zookeeper.ZKUtil(164): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:59:57,202 DEBUG [Listener at localhost/37075] zookeeper.ZKUtil(164): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-03 08:59:57,203 DEBUG [Listener at localhost/37075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37979 2023-08-03 08:59:57,203 DEBUG [Listener at localhost/37075] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37979 2023-08-03 08:59:57,203 DEBUG [Listener at localhost/37075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37979 2023-08-03 08:59:57,204 DEBUG [Listener at localhost/37075] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37979 2023-08-03 08:59:57,204 DEBUG [Listener at localhost/37075] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37979 2023-08-03 08:59:57,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42183,1691053197141 2023-08-03 08:59:57,207 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-03 08:59:57,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42183,1691053197141 2023-08-03 08:59:57,208 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-03 08:59:57,208 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-03 08:59:57,209 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:57,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-03 08:59:57,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-03 08:59:57,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42183,1691053197141 from backup master directory 2023-08-03 08:59:57,211 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42183,1691053197141 2023-08-03 08:59:57,211 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-03 08:59:57,211 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-03 08:59:57,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42183,1691053197141 2023-08-03 08:59:57,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/hbase.id with ID: 428357de-3299-4a88-9172-8ec1e9bb601f 2023-08-03 08:59:57,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:59:57,241 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:57,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x23360397 to 127.0.0.1:59414 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-03 08:59:57,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56b3f1fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-03 08:59:57,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-03 08:59:57,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-03 08:59:57,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:59:57,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/data/master/store-tmp 2023-08-03 08:59:57,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:59:57,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-03 08:59:57,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:59:57,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:59:57,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-03 08:59:57,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:59:57,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:59:57,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-03 08:59:57,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/WALs/jenkins-hbase4.apache.org,42183,1691053197141 2023-08-03 08:59:57,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42183%2C1691053197141, suffix=, logDir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/WALs/jenkins-hbase4.apache.org,42183,1691053197141, archiveDir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/oldWALs, maxLogs=10 2023-08-03 08:59:57,285 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39427,DS-e4ea5711-fe0b-4480-93c9-47a91b8d70a2,DISK] 2023-08-03 08:59:57,285 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39021,DS-ee8abfb2-d3d3-44c5-b6b1-a6e91e14044b,DISK] 2023-08-03 08:59:57,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/WALs/jenkins-hbase4.apache.org,42183,1691053197141/jenkins-hbase4.apache.org%2C42183%2C1691053197141.1691053197270 2023-08-03 08:59:57,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39427,DS-e4ea5711-fe0b-4480-93c9-47a91b8d70a2,DISK], DatanodeInfoWithStorage[127.0.0.1:39021,DS-ee8abfb2-d3d3-44c5-b6b1-a6e91e14044b,DISK]] 2023-08-03 08:59:57,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:59:57,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:59:57,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:59:57,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:59:57,290 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:59:57,291 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-03 08:59:57,291 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-03 08:59:57,292 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:59:57,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:59:57,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:59:57,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-03 08:59:57,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:59:57,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=703829, jitterRate=-0.1050361841917038}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:59:57,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-03 08:59:57,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-03 08:59:57,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-03 08:59:57,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-03 08:59:57,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-03 08:59:57,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-03 08:59:57,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-03 08:59:57,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-03 08:59:57,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-03 08:59:57,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-03 08:59:57,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-03 08:59:57,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-03 08:59:57,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-03 08:59:57,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-03 08:59:57,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-03 08:59:57,313 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:57,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-03 08:59:57,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-03 08:59:57,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-03 08:59:57,316 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-03 08:59:57,316 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-03 08:59:57,316 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:57,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42183,1691053197141, sessionid=0x101ca0e8a450000, setting cluster-up flag (Was=false) 2023-08-03 08:59:57,321 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:57,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-03 08:59:57,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42183,1691053197141 2023-08-03 08:59:57,329 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:57,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-03 08:59:57,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42183,1691053197141 2023-08-03 08:59:57,335 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/.hbase-snapshot/.tmp 2023-08-03 08:59:57,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-03 08:59:57,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:59:57,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:59:57,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:59:57,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-03 08:59:57,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-03 08:59:57,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:59:57,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-03 08:59:57,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:59:57,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1691053227338 2023-08-03 08:59:57,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-03 08:59:57,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-03 08:59:57,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-03 08:59:57,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-03 08:59:57,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-03 08:59:57,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-03 08:59:57,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,339 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-03 08:59:57,339 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-03 08:59:57,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-03 08:59:57,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-03 08:59:57,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-03 08:59:57,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-03 08:59:57,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-03 08:59:57,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691053197340,5,FailOnTimeoutGroup] 2023-08-03 08:59:57,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691053197340,5,FailOnTimeoutGroup] 2023-08-03 08:59:57,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-03 08:59:57,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,340 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-03 08:59:57,348 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-03 08:59:57,349 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-03 08:59:57,349 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45 2023-08-03 08:59:57,356 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:59:57,357 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-03 08:59:57,358 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/info 2023-08-03 08:59:57,359 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-03 08:59:57,359 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:59:57,359 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-03 08:59:57,360 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/rep_barrier 2023-08-03 08:59:57,361 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-03 08:59:57,361 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:59:57,361 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-03 08:59:57,362 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/table 2023-08-03 08:59:57,363 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-03 08:59:57,363 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:59:57,364 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740 2023-08-03 08:59:57,364 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740 2023-08-03 08:59:57,366 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-03 08:59:57,367 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-03 08:59:57,369 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:59:57,369 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=693470, jitterRate=-0.11820776760578156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-03 08:59:57,370 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-03 08:59:57,370 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-03 08:59:57,370 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-03 08:59:57,370 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-03 08:59:57,370 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-03 08:59:57,370 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-03 08:59:57,370 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-03 08:59:57,370 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-03 08:59:57,371 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-03 08:59:57,371 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-03 08:59:57,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-03 08:59:57,372 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-03 08:59:57,374 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-03 08:59:57,405 INFO [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(951): ClusterId : 428357de-3299-4a88-9172-8ec1e9bb601f 2023-08-03 08:59:57,406 DEBUG [RS:0;jenkins-hbase4:37979] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-03 08:59:57,408 DEBUG [RS:0;jenkins-hbase4:37979] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-03 08:59:57,408 DEBUG [RS:0;jenkins-hbase4:37979] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-03 08:59:57,410 DEBUG [RS:0;jenkins-hbase4:37979] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-03 08:59:57,411 DEBUG [RS:0;jenkins-hbase4:37979] zookeeper.ReadOnlyZKClient(139): Connect 0x6eb76943 to 127.0.0.1:59414 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-03 08:59:57,415 DEBUG [RS:0;jenkins-hbase4:37979] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60709ae5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-03 08:59:57,415 DEBUG [RS:0;jenkins-hbase4:37979] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@644f0233, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-03 08:59:57,424 DEBUG [RS:0;jenkins-hbase4:37979] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37979 2023-08-03 08:59:57,424 INFO [RS:0;jenkins-hbase4:37979] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-03 08:59:57,424 INFO [RS:0;jenkins-hbase4:37979] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-03 08:59:57,424 DEBUG [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(1022): About to register with Master. 2023-08-03 08:59:57,424 INFO [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42183,1691053197141 with isa=jenkins-hbase4.apache.org/172.31.14.131:37979, startcode=1691053197184 2023-08-03 08:59:57,424 DEBUG [RS:0;jenkins-hbase4:37979] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-03 08:59:57,426 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36009, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-08-03 08:59:57,427 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42183] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37979,1691053197184 2023-08-03 08:59:57,428 DEBUG [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45 2023-08-03 08:59:57,428 DEBUG [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33377 2023-08-03 08:59:57,428 DEBUG [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-03 08:59:57,429 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-03 08:59:57,429 DEBUG [RS:0;jenkins-hbase4:37979] zookeeper.ZKUtil(162): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37979,1691053197184 2023-08-03 08:59:57,430 WARN [RS:0;jenkins-hbase4:37979] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-03 08:59:57,430 INFO [RS:0;jenkins-hbase4:37979] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:59:57,430 DEBUG [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/WALs/jenkins-hbase4.apache.org,37979,1691053197184 2023-08-03 08:59:57,430 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37979,1691053197184] 2023-08-03 08:59:57,433 DEBUG [RS:0;jenkins-hbase4:37979] zookeeper.ZKUtil(162): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37979,1691053197184 2023-08-03 08:59:57,434 DEBUG [RS:0;jenkins-hbase4:37979] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-03 08:59:57,434 INFO [RS:0;jenkins-hbase4:37979] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-03 08:59:57,435 INFO [RS:0;jenkins-hbase4:37979] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-03 08:59:57,435 INFO [RS:0;jenkins-hbase4:37979] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-03 08:59:57,435 INFO [RS:0;jenkins-hbase4:37979] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,436 INFO [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-03 08:59:57,436 INFO [RS:0;jenkins-hbase4:37979] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,437 DEBUG [RS:0;jenkins-hbase4:37979] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:59:57,437 DEBUG [RS:0;jenkins-hbase4:37979] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:59:57,437 DEBUG [RS:0;jenkins-hbase4:37979] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:59:57,437 DEBUG [RS:0;jenkins-hbase4:37979] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:59:57,437 DEBUG [RS:0;jenkins-hbase4:37979] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:59:57,437 DEBUG [RS:0;jenkins-hbase4:37979] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-03 08:59:57,437 DEBUG [RS:0;jenkins-hbase4:37979] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:59:57,437 DEBUG [RS:0;jenkins-hbase4:37979] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:59:57,437 DEBUG [RS:0;jenkins-hbase4:37979] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:59:57,437 DEBUG [RS:0;jenkins-hbase4:37979] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-03 08:59:57,439 INFO [RS:0;jenkins-hbase4:37979] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,439 INFO [RS:0;jenkins-hbase4:37979] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,440 INFO [RS:0;jenkins-hbase4:37979] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,451 INFO [RS:0;jenkins-hbase4:37979] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-03 08:59:57,451 INFO [RS:0;jenkins-hbase4:37979] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37979,1691053197184-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,461 INFO [RS:0;jenkins-hbase4:37979] regionserver.Replication(203): jenkins-hbase4.apache.org,37979,1691053197184 started 2023-08-03 08:59:57,461 INFO [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37979,1691053197184, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37979, sessionid=0x101ca0e8a450001 2023-08-03 08:59:57,461 DEBUG [RS:0;jenkins-hbase4:37979] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-03 08:59:57,461 DEBUG [RS:0;jenkins-hbase4:37979] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37979,1691053197184 2023-08-03 08:59:57,461 DEBUG [RS:0;jenkins-hbase4:37979] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37979,1691053197184' 2023-08-03 08:59:57,461 DEBUG [RS:0;jenkins-hbase4:37979] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-03 08:59:57,462 DEBUG [RS:0;jenkins-hbase4:37979] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-03 08:59:57,462 DEBUG [RS:0;jenkins-hbase4:37979] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-03 08:59:57,462 DEBUG [RS:0;jenkins-hbase4:37979] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-03 08:59:57,462 DEBUG [RS:0;jenkins-hbase4:37979] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37979,1691053197184 2023-08-03 08:59:57,462 DEBUG [RS:0;jenkins-hbase4:37979] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37979,1691053197184' 2023-08-03 08:59:57,462 DEBUG [RS:0;jenkins-hbase4:37979] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-03 08:59:57,462 DEBUG [RS:0;jenkins-hbase4:37979] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-03 08:59:57,463 DEBUG [RS:0;jenkins-hbase4:37979] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-03 08:59:57,463 INFO [RS:0;jenkins-hbase4:37979] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-03 08:59:57,463 INFO [RS:0;jenkins-hbase4:37979] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-03 08:59:57,524 DEBUG [jenkins-hbase4:42183] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-03 08:59:57,525 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37979,1691053197184, state=OPENING 2023-08-03 08:59:57,527 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-03 08:59:57,528 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:57,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37979,1691053197184}] 2023-08-03 08:59:57,529 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-03 08:59:57,564 INFO [RS:0;jenkins-hbase4:37979] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37979%2C1691053197184, suffix=, logDir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/WALs/jenkins-hbase4.apache.org,37979,1691053197184, archiveDir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/oldWALs, maxLogs=32 2023-08-03 08:59:57,580 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39427,DS-e4ea5711-fe0b-4480-93c9-47a91b8d70a2,DISK] 2023-08-03 08:59:57,580 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39021,DS-ee8abfb2-d3d3-44c5-b6b1-a6e91e14044b,DISK] 2023-08-03 08:59:57,582 INFO [RS:0;jenkins-hbase4:37979] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/WALs/jenkins-hbase4.apache.org,37979,1691053197184/jenkins-hbase4.apache.org%2C37979%2C1691053197184.1691053197565 2023-08-03 08:59:57,582 DEBUG [RS:0;jenkins-hbase4:37979] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39427,DS-e4ea5711-fe0b-4480-93c9-47a91b8d70a2,DISK], DatanodeInfoWithStorage[127.0.0.1:39021,DS-ee8abfb2-d3d3-44c5-b6b1-a6e91e14044b,DISK]] 2023-08-03 08:59:57,683 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37979,1691053197184 2023-08-03 08:59:57,683 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-03 08:59:57,685 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-03 08:59:57,688 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-03 08:59:57,688 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:59:57,690 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37979%2C1691053197184.meta, suffix=.meta, logDir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/WALs/jenkins-hbase4.apache.org,37979,1691053197184, archiveDir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/oldWALs, maxLogs=32 2023-08-03 08:59:57,704 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39021,DS-ee8abfb2-d3d3-44c5-b6b1-a6e91e14044b,DISK] 2023-08-03 08:59:57,705 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39427,DS-e4ea5711-fe0b-4480-93c9-47a91b8d70a2,DISK] 2023-08-03 08:59:57,706 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/WALs/jenkins-hbase4.apache.org,37979,1691053197184/jenkins-hbase4.apache.org%2C37979%2C1691053197184.meta.1691053197690.meta 2023-08-03 08:59:57,707 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39021,DS-ee8abfb2-d3d3-44c5-b6b1-a6e91e14044b,DISK], DatanodeInfoWithStorage[127.0.0.1:39427,DS-e4ea5711-fe0b-4480-93c9-47a91b8d70a2,DISK]] 2023-08-03 08:59:57,707 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:59:57,707 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-03 08:59:57,707 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-03 08:59:57,707 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-03 08:59:57,707 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-03 08:59:57,707 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:59:57,707 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-03 08:59:57,707 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-03 08:59:57,711 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-03 08:59:57,712 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/info 2023-08-03 08:59:57,712 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/info 2023-08-03 08:59:57,712 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-03 08:59:57,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:59:57,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-03 08:59:57,714 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/rep_barrier 2023-08-03 08:59:57,714 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/rep_barrier 2023-08-03 08:59:57,714 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-03 08:59:57,715 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:59:57,715 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-03 08:59:57,716 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/table 2023-08-03 08:59:57,716 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/table 2023-08-03 08:59:57,716 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-03 08:59:57,716 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:59:57,717 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740 2023-08-03 08:59:57,718 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740 2023-08-03 08:59:57,720 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-03 08:59:57,721 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-03 08:59:57,722 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=729081, jitterRate=-0.07292585074901581}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-03 08:59:57,722 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-03 08:59:57,723 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1691053197682 2023-08-03 08:59:57,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-03 08:59:57,727 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-03 08:59:57,727 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37979,1691053197184, state=OPEN 2023-08-03 08:59:57,730 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-03 08:59:57,730 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-03 08:59:57,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-03 08:59:57,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37979,1691053197184 in 202 msec 2023-08-03 08:59:57,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-03 08:59:57,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-08-03 08:59:57,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-08-03 08:59:57,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1691053197735, completionTime=-1 2023-08-03 08:59:57,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-03 08:59:57,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-03 08:59:57,737 DEBUG [hconnection-0x3d715ef2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-03 08:59:57,739 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-03 08:59:57,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-03 08:59:57,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1691053257740 2023-08-03 08:59:57,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1691053317740 2023-08-03 08:59:57,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-08-03 08:59:57,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42183,1691053197141-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42183,1691053197141-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42183,1691053197141-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42183, period=300000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-03 08:59:57,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-03 08:59:57,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-03 08:59:57,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-03 08:59:57,748 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-03 08:59:57,749 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-03 08:59:57,750 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-03 08:59:57,751 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/.tmp/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8 2023-08-03 08:59:57,752 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/.tmp/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8 empty. 2023-08-03 08:59:57,752 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/.tmp/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8 2023-08-03 08:59:57,752 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-03 08:59:57,762 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-03 08:59:57,764 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => bf9c0e451b224c0d5283e464308dc3e8, NAME => 'hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/.tmp 2023-08-03 08:59:57,771 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:59:57,771 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing bf9c0e451b224c0d5283e464308dc3e8, disabling compactions & flushes 2023-08-03 08:59:57,771 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. 2023-08-03 08:59:57,771 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. 2023-08-03 08:59:57,772 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. after waiting 0 ms 2023-08-03 08:59:57,772 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. 2023-08-03 08:59:57,772 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. 2023-08-03 08:59:57,772 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for bf9c0e451b224c0d5283e464308dc3e8: 2023-08-03 08:59:57,774 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-03 08:59:57,775 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691053197775"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691053197775"}]},"ts":"1691053197775"} 2023-08-03 08:59:57,776 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-03 08:59:57,777 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-03 08:59:57,777 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053197777"}]},"ts":"1691053197777"} 2023-08-03 08:59:57,779 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-03 08:59:57,786 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bf9c0e451b224c0d5283e464308dc3e8, ASSIGN}] 2023-08-03 08:59:57,788 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bf9c0e451b224c0d5283e464308dc3e8, ASSIGN 2023-08-03 08:59:57,788 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=bf9c0e451b224c0d5283e464308dc3e8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37979,1691053197184; forceNewPlan=false, retain=false 2023-08-03 08:59:57,939 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bf9c0e451b224c0d5283e464308dc3e8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37979,1691053197184 2023-08-03 08:59:57,940 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691053197939"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691053197939"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691053197939"}]},"ts":"1691053197939"} 2023-08-03 08:59:57,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure bf9c0e451b224c0d5283e464308dc3e8, server=jenkins-hbase4.apache.org,37979,1691053197184}] 2023-08-03 08:59:58,097 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. 2023-08-03 08:59:58,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bf9c0e451b224c0d5283e464308dc3e8, NAME => 'hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8.', STARTKEY => '', ENDKEY => ''} 2023-08-03 08:59:58,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace bf9c0e451b224c0d5283e464308dc3e8 2023-08-03 08:59:58,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-03 08:59:58,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bf9c0e451b224c0d5283e464308dc3e8 2023-08-03 08:59:58,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bf9c0e451b224c0d5283e464308dc3e8 2023-08-03 08:59:58,098 INFO [StoreOpener-bf9c0e451b224c0d5283e464308dc3e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region bf9c0e451b224c0d5283e464308dc3e8 2023-08-03 08:59:58,099 DEBUG [StoreOpener-bf9c0e451b224c0d5283e464308dc3e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8/info 2023-08-03 08:59:58,100 DEBUG [StoreOpener-bf9c0e451b224c0d5283e464308dc3e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8/info 2023-08-03 08:59:58,100 INFO [StoreOpener-bf9c0e451b224c0d5283e464308dc3e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf9c0e451b224c0d5283e464308dc3e8 columnFamilyName info 2023-08-03 08:59:58,100 INFO [StoreOpener-bf9c0e451b224c0d5283e464308dc3e8-1] regionserver.HStore(310): Store=bf9c0e451b224c0d5283e464308dc3e8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-03 08:59:58,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8 2023-08-03 08:59:58,102 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8 2023-08-03 08:59:58,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bf9c0e451b224c0d5283e464308dc3e8 2023-08-03 08:59:58,105 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-03 08:59:58,106 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bf9c0e451b224c0d5283e464308dc3e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=844534, jitterRate=0.07388105988502502}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-03 08:59:58,106 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bf9c0e451b224c0d5283e464308dc3e8: 2023-08-03 08:59:58,107 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8., pid=6, masterSystemTime=1691053198093 2023-08-03 08:59:58,108 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. 2023-08-03 08:59:58,108 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. 2023-08-03 08:59:58,109 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bf9c0e451b224c0d5283e464308dc3e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37979,1691053197184 2023-08-03 08:59:58,109 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691053198108"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691053198108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691053198108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691053198108"}]},"ts":"1691053198108"} 2023-08-03 08:59:58,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-03 08:59:58,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure bf9c0e451b224c0d5283e464308dc3e8, server=jenkins-hbase4.apache.org,37979,1691053197184 in 169 msec 2023-08-03 08:59:58,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-03 08:59:58,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=bf9c0e451b224c0d5283e464308dc3e8, ASSIGN in 325 msec 2023-08-03 08:59:58,114 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-03 08:59:58,114 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691053198114"}]},"ts":"1691053198114"} 2023-08-03 08:59:58,115 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-03 08:59:58,118 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-03 08:59:58,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 371 msec 2023-08-03 08:59:58,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-03 08:59:58,150 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-03 08:59:58,150 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:58,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-03 08:59:58,161 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-03 08:59:58,165 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-08-03 08:59:58,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-03 08:59:58,182 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-03 08:59:58,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-08-03 08:59:58,201 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-03 08:59:58,204 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-03 08:59:58,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.993sec 2023-08-03 08:59:58,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-03 08:59:58,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-03 08:59:58,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-03 08:59:58,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42183,1691053197141-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-03 08:59:58,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42183,1691053197141-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-03 08:59:58,206 DEBUG [Listener at localhost/37075] zookeeper.ReadOnlyZKClient(139): Connect 0x0241d7be to 127.0.0.1:59414 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-03 08:59:58,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-03 08:59:58,212 DEBUG [Listener at localhost/37075] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eab0b6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-03 08:59:58,214 DEBUG [hconnection-0x78768ef6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-03 08:59:58,216 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-03 08:59:58,217 INFO [Listener at localhost/37075] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42183,1691053197141 2023-08-03 08:59:58,217 INFO [Listener at localhost/37075] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-03 08:59:58,220 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-03 08:59:58,220 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:58,221 INFO [Listener at localhost/37075] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-03 08:59:58,221 INFO [Listener at localhost/37075] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-03 08:59:58,223 INFO [Listener at localhost/37075] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=test.com%2C8080%2C1, suffix=, logDir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/WALs/test.com,8080,1, archiveDir=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/oldWALs, maxLogs=32 2023-08-03 08:59:58,238 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39021,DS-ee8abfb2-d3d3-44c5-b6b1-a6e91e14044b,DISK] 2023-08-03 08:59:58,238 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39427,DS-e4ea5711-fe0b-4480-93c9-47a91b8d70a2,DISK] 2023-08-03 08:59:58,240 INFO [Listener at localhost/37075] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/WALs/test.com,8080,1/test.com%2C8080%2C1.1691053198223 2023-08-03 08:59:58,240 DEBUG [Listener at localhost/37075] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39021,DS-ee8abfb2-d3d3-44c5-b6b1-a6e91e14044b,DISK], DatanodeInfoWithStorage[127.0.0.1:39427,DS-e4ea5711-fe0b-4480-93c9-47a91b8d70a2,DISK]] 2023-08-03 08:59:58,253 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39427,DS-e4ea5711-fe0b-4480-93c9-47a91b8d70a2,DISK] 2023-08-03 08:59:58,254 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39021,DS-ee8abfb2-d3d3-44c5-b6b1-a6e91e14044b,DISK] 2023-08-03 08:59:58,255 INFO [Listener at localhost/37075] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/WALs/test.com,8080,1/test.com%2C8080%2C1.1691053198223 with entries=0, filesize=83 B; new WAL /user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/WALs/test.com,8080,1/test.com%2C8080%2C1.1691053198240 2023-08-03 08:59:58,256 DEBUG [Listener at localhost/37075] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39427,DS-e4ea5711-fe0b-4480-93c9-47a91b8d70a2,DISK], DatanodeInfoWithStorage[127.0.0.1:39021,DS-ee8abfb2-d3d3-44c5-b6b1-a6e91e14044b,DISK]] 2023-08-03 08:59:58,256 DEBUG [Listener at localhost/37075] wal.AbstractFSWAL(716): hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/WALs/test.com,8080,1/test.com%2C8080%2C1.1691053198223 is not closed yet, will try archiving it next time 2023-08-03 08:59:58,264 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/WALs/test.com,8080,1/test.com%2C8080%2C1.1691053198223 to hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/oldWALs/test.com%2C8080%2C1.1691053198223 2023-08-03 08:59:58,266 DEBUG [Listener at localhost/37075] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/oldWALs 2023-08-03 08:59:58,266 INFO [Listener at localhost/37075] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL test.com%2C8080%2C1:(num 1691053198240) 2023-08-03 08:59:58,267 INFO [Listener at localhost/37075] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-03 08:59:58,267 DEBUG [Listener at localhost/37075] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0241d7be to 127.0.0.1:59414 2023-08-03 08:59:58,267 DEBUG [Listener at localhost/37075] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:59:58,267 DEBUG [Listener at localhost/37075] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-03 08:59:58,267 DEBUG [Listener at localhost/37075] util.JVMClusterUtil(257): Found active master hash=1957405050, stopped=false 2023-08-03 08:59:58,267 INFO [Listener at localhost/37075] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42183,1691053197141 2023-08-03 08:59:58,271 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-03 08:59:58,271 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-03 08:59:58,271 INFO [Listener at localhost/37075] procedure2.ProcedureExecutor(629): Stopping 2023-08-03 08:59:58,271 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:58,272 DEBUG [Listener at localhost/37075] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23360397 to 127.0.0.1:59414 2023-08-03 08:59:58,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:59:58,272 DEBUG [Listener at localhost/37075] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:59:58,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-03 08:59:58,272 INFO [Listener at localhost/37075] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37979,1691053197184' ***** 2023-08-03 08:59:58,272 INFO [Listener at localhost/37075] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-03 08:59:58,273 INFO [RS:0;jenkins-hbase4:37979] regionserver.HeapMemoryManager(220): Stopping 2023-08-03 08:59:58,273 INFO [RS:0;jenkins-hbase4:37979] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-03 08:59:58,273 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-03 08:59:58,273 INFO [RS:0;jenkins-hbase4:37979] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-03 08:59:58,273 INFO [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(3305): Received CLOSE for bf9c0e451b224c0d5283e464308dc3e8 2023-08-03 08:59:58,273 INFO [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37979,1691053197184 2023-08-03 08:59:58,273 DEBUG [RS:0;jenkins-hbase4:37979] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6eb76943 to 127.0.0.1:59414 2023-08-03 08:59:58,273 DEBUG [RS:0;jenkins-hbase4:37979] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:59:58,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bf9c0e451b224c0d5283e464308dc3e8, disabling compactions & flushes 2023-08-03 08:59:58,274 INFO [RS:0;jenkins-hbase4:37979] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-03 08:59:58,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. 2023-08-03 08:59:58,274 INFO [RS:0;jenkins-hbase4:37979] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-03 08:59:58,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. 2023-08-03 08:59:58,274 INFO [RS:0;jenkins-hbase4:37979] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-03 08:59:58,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. after waiting 0 ms 2023-08-03 08:59:58,274 INFO [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-03 08:59:58,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. 2023-08-03 08:59:58,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing bf9c0e451b224c0d5283e464308dc3e8 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-03 08:59:58,274 INFO [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-08-03 08:59:58,274 DEBUG [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, bf9c0e451b224c0d5283e464308dc3e8=hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8.} 2023-08-03 08:59:58,274 DEBUG [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(1504): Waiting on 1588230740, bf9c0e451b224c0d5283e464308dc3e8 2023-08-03 08:59:58,275 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-03 08:59:58,275 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-03 08:59:58,275 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-03 08:59:58,275 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-03 08:59:58,275 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-03 08:59:58,275 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=1.26 KB heapSize=2.89 KB 2023-08-03 08:59:58,291 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.17 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/.tmp/info/da846cd72dd24432b98d7ac337c190b8 2023-08-03 08:59:58,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8/.tmp/info/5c50061eccff4c369b33daedd055bca8 2023-08-03 08:59:58,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8/.tmp/info/5c50061eccff4c369b33daedd055bca8 as hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8/info/5c50061eccff4c369b33daedd055bca8 2023-08-03 08:59:58,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8/info/5c50061eccff4c369b33daedd055bca8, entries=2, sequenceid=6, filesize=4.8 K 2023-08-03 08:59:58,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for bf9c0e451b224c0d5283e464308dc3e8 in 37ms, sequenceid=6, compaction requested=false 2023-08-03 08:59:58,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-03 08:59:58,314 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=94 B at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/.tmp/table/2bf9e2e3168343379f01baaafb82647b 2023-08-03 08:59:58,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/namespace/bf9c0e451b224c0d5283e464308dc3e8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-03 08:59:58,321 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/.tmp/info/da846cd72dd24432b98d7ac337c190b8 as hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/info/da846cd72dd24432b98d7ac337c190b8 2023-08-03 08:59:58,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. 2023-08-03 08:59:58,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bf9c0e451b224c0d5283e464308dc3e8: 2023-08-03 08:59:58,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1691053197747.bf9c0e451b224c0d5283e464308dc3e8. 2023-08-03 08:59:58,326 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/info/da846cd72dd24432b98d7ac337c190b8, entries=10, sequenceid=9, filesize=5.9 K 2023-08-03 08:59:58,328 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/.tmp/table/2bf9e2e3168343379f01baaafb82647b as hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/table/2bf9e2e3168343379f01baaafb82647b 2023-08-03 08:59:58,333 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/table/2bf9e2e3168343379f01baaafb82647b, entries=2, sequenceid=9, filesize=4.7 K 2023-08-03 08:59:58,334 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.26 KB/1290, heapSize ~2.61 KB/2672, currentSize=0 B/0 for 1588230740 in 59ms, sequenceid=9, compaction requested=false 2023-08-03 08:59:58,334 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-03 08:59:58,344 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/data/hbase/meta/1588230740/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-08-03 08:59:58,344 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-03 08:59:58,344 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-03 08:59:58,344 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-03 08:59:58,345 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-03 08:59:58,439 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-03 08:59:58,439 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-03 08:59:58,475 INFO [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37979,1691053197184; all regions closed. 2023-08-03 08:59:58,480 DEBUG [RS:0;jenkins-hbase4:37979] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/oldWALs 2023-08-03 08:59:58,480 INFO [RS:0;jenkins-hbase4:37979] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37979%2C1691053197184.meta:.meta(num 1691053197690) 2023-08-03 08:59:58,482 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/WALs/jenkins-hbase4.apache.org,37979,1691053197184/jenkins-hbase4.apache.org%2C37979%2C1691053197184.1691053197565 not finished, retry = 0 2023-08-03 08:59:58,585 DEBUG [RS:0;jenkins-hbase4:37979] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/oldWALs 2023-08-03 08:59:58,585 INFO [RS:0;jenkins-hbase4:37979] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37979%2C1691053197184:(num 1691053197565) 2023-08-03 08:59:58,585 DEBUG [RS:0;jenkins-hbase4:37979] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:59:58,585 INFO [RS:0;jenkins-hbase4:37979] regionserver.LeaseManager(133): Closed leases 2023-08-03 08:59:58,585 INFO [RS:0;jenkins-hbase4:37979] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-08-03 08:59:58,585 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-03 08:59:58,586 INFO [RS:0;jenkins-hbase4:37979] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37979 2023-08-03 08:59:58,589 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37979,1691053197184 2023-08-03 08:59:58,589 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-03 08:59:58,589 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-03 08:59:58,591 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37979,1691053197184] 2023-08-03 08:59:58,591 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37979,1691053197184; numProcessing=1 2023-08-03 08:59:58,592 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37979,1691053197184 already deleted, retry=false 2023-08-03 08:59:58,592 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37979,1691053197184 expired; onlineServers=0 2023-08-03 08:59:58,592 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42183,1691053197141' ***** 2023-08-03 08:59:58,592 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-03 08:59:58,593 DEBUG [M:0;jenkins-hbase4:42183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70942b37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-03 08:59:58,593 INFO [M:0;jenkins-hbase4:42183] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42183,1691053197141 2023-08-03 08:59:58,593 INFO [M:0;jenkins-hbase4:42183] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42183,1691053197141; all regions closed. 2023-08-03 08:59:58,593 DEBUG [M:0;jenkins-hbase4:42183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-03 08:59:58,593 DEBUG [M:0;jenkins-hbase4:42183] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-03 08:59:58,593 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-03 08:59:58,593 DEBUG [M:0;jenkins-hbase4:42183] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-03 08:59:58,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691053197340] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691053197340,5,FailOnTimeoutGroup] 2023-08-03 08:59:58,593 INFO [M:0;jenkins-hbase4:42183] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-03 08:59:58,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691053197340] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691053197340,5,FailOnTimeoutGroup] 2023-08-03 08:59:58,594 INFO [M:0;jenkins-hbase4:42183] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-03 08:59:58,594 INFO [M:0;jenkins-hbase4:42183] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-03 08:59:58,594 DEBUG [M:0;jenkins-hbase4:42183] master.HMaster(1512): Stopping service threads 2023-08-03 08:59:58,594 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-03 08:59:58,594 INFO [M:0;jenkins-hbase4:42183] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-03 08:59:58,594 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-03 08:59:58,595 ERROR [M:0;jenkins-hbase4:42183] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-7,5,PEWorkerGroup] 2023-08-03 08:59:58,595 INFO [M:0;jenkins-hbase4:42183] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-03 08:59:58,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-03 08:59:58,595 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-03 08:59:58,595 DEBUG [M:0;jenkins-hbase4:42183] zookeeper.ZKUtil(398): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-03 08:59:58,595 WARN [M:0;jenkins-hbase4:42183] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-03 08:59:58,596 INFO [M:0;jenkins-hbase4:42183] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-03 08:59:58,596 INFO [M:0;jenkins-hbase4:42183] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-03 08:59:58,596 DEBUG [M:0;jenkins-hbase4:42183] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-03 08:59:58,596 INFO [M:0;jenkins-hbase4:42183] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:59:58,596 DEBUG [M:0;jenkins-hbase4:42183] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:59:58,596 DEBUG [M:0;jenkins-hbase4:42183] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-03 08:59:58,596 DEBUG [M:0;jenkins-hbase4:42183] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:59:58,597 INFO [M:0;jenkins-hbase4:42183] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=24.07 KB heapSize=29.55 KB 2023-08-03 08:59:58,610 INFO [M:0;jenkins-hbase4:42183] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24.07 KB at sequenceid=66 (bloomFilter=true), to=hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0ee425401ea846ea8fdb0315c03ea062 2023-08-03 08:59:58,615 DEBUG [M:0;jenkins-hbase4:42183] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0ee425401ea846ea8fdb0315c03ea062 as hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0ee425401ea846ea8fdb0315c03ea062 2023-08-03 08:59:58,620 INFO [M:0;jenkins-hbase4:42183] regionserver.HStore(1080): Added hdfs://localhost:33377/user/jenkins/test-data/cb0a6d93-8992-8b3b-d9f0-ef3f4d0f9f45/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0ee425401ea846ea8fdb0315c03ea062, entries=8, sequenceid=66, filesize=6.3 K 2023-08-03 08:59:58,620 INFO [M:0;jenkins-hbase4:42183] regionserver.HRegion(2948): Finished flush of dataSize ~24.07 KB/24646, heapSize ~29.54 KB/30248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=66, compaction requested=false 2023-08-03 08:59:58,622 INFO [M:0;jenkins-hbase4:42183] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-03 08:59:58,622 DEBUG [M:0;jenkins-hbase4:42183] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-03 08:59:58,625 INFO [M:0;jenkins-hbase4:42183] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-03 08:59:58,625 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-03 08:59:58,625 INFO [M:0;jenkins-hbase4:42183] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42183 2023-08-03 08:59:58,628 DEBUG [M:0;jenkins-hbase4:42183] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42183,1691053197141 already deleted, retry=false 2023-08-03 08:59:58,691 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:59:58,691 INFO [RS:0;jenkins-hbase4:37979] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37979,1691053197184; zookeeper connection closed. 2023-08-03 08:59:58,691 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): regionserver:37979-0x101ca0e8a450001, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:59:58,692 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@10bd574] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@10bd574 2023-08-03 08:59:58,692 INFO [Listener at localhost/37075] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-03 08:59:58,792 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:59:58,792 INFO [M:0;jenkins-hbase4:42183] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42183,1691053197141; zookeeper connection closed. 2023-08-03 08:59:58,792 DEBUG [Listener at localhost/37075-EventThread] zookeeper.ZKWatcher(600): master:42183-0x101ca0e8a450000, quorum=127.0.0.1:59414, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-03 08:59:58,793 WARN [Listener at localhost/37075] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-03 08:59:58,797 INFO [Listener at localhost/37075] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:59:58,901 WARN [BP-1889745942-172.31.14.131-1691053196588 heartbeating to localhost/127.0.0.1:33377] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-03 08:59:58,901 WARN [BP-1889745942-172.31.14.131-1691053196588 heartbeating to localhost/127.0.0.1:33377] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1889745942-172.31.14.131-1691053196588 (Datanode Uuid edb875dd-4024-4923-8ed5-d21b2f1c63a3) service to localhost/127.0.0.1:33377 2023-08-03 08:59:58,902 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/cluster_eedacf70-02a4-f29e-b5c2-4dc6932c7cb8/dfs/data/data3/current/BP-1889745942-172.31.14.131-1691053196588] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:59:58,902 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/cluster_eedacf70-02a4-f29e-b5c2-4dc6932c7cb8/dfs/data/data4/current/BP-1889745942-172.31.14.131-1691053196588] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:59:58,903 WARN [Listener at localhost/37075] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-03 08:59:58,907 INFO [Listener at localhost/37075] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:59:59,010 WARN [BP-1889745942-172.31.14.131-1691053196588 heartbeating to localhost/127.0.0.1:33377] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-03 08:59:59,010 WARN [BP-1889745942-172.31.14.131-1691053196588 heartbeating to localhost/127.0.0.1:33377] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1889745942-172.31.14.131-1691053196588 (Datanode Uuid 6238f14d-d726-4eab-8c33-ff9c9048a62b) service to localhost/127.0.0.1:33377 2023-08-03 08:59:59,011 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/cluster_eedacf70-02a4-f29e-b5c2-4dc6932c7cb8/dfs/data/data1/current/BP-1889745942-172.31.14.131-1691053196588] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:59:59,011 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/768f7da0-0c9a-f80d-79e1-06dcf0d2b69e/cluster_eedacf70-02a4-f29e-b5c2-4dc6932c7cb8/dfs/data/data2/current/BP-1889745942-172.31.14.131-1691053196588] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-03 08:59:59,026 INFO [Listener at localhost/37075] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-03 08:59:59,137 INFO [Listener at localhost/37075] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-03 08:59:59,149 INFO [Listener at localhost/37075] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-03 08:59:59,159 INFO [Listener at localhost/37075] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=101 (was 76) - Thread LEAK? -, OpenFileDescriptor=499 (was 471) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 204), ProcessCount=177 (was 177), AvailableMemoryMB=982 (was 988)