2023-08-25 16:58:36,432 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345 2023-08-25 16:58:36,447 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling timeout: 13 mins 2023-08-25 16:58:36,482 INFO [Time-limited test] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=181, ProcessCount=169, AvailableMemoryMB=6566 2023-08-25 16:58:36,489 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-25 16:58:36,490 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d, deleteOnExit=true 2023-08-25 16:58:36,490 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-25 16:58:36,490 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/test.cache.data in system properties and HBase conf 2023-08-25 16:58:36,491 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/hadoop.tmp.dir in system properties and HBase conf 2023-08-25 16:58:36,491 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/hadoop.log.dir in system properties and HBase conf 2023-08-25 16:58:36,492 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-25 16:58:36,492 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-25 16:58:36,492 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-25 16:58:36,605 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-08-25 16:58:36,987 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-25 16:58:36,991 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-25 16:58:36,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-25 16:58:36,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-25 16:58:36,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-25 16:58:36,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-25 16:58:36,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-25 16:58:36,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-25 16:58:36,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-25 16:58:36,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-25 16:58:36,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/nfs.dump.dir in system properties and HBase conf 2023-08-25 16:58:36,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/java.io.tmpdir in system properties and HBase conf 2023-08-25 16:58:36,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-25 16:58:36,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-25 16:58:36,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-25 16:58:37,481 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-25 16:58:37,486 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-25 16:58:37,776 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-08-25 16:58:37,937 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-08-25 16:58:37,952 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 16:58:37,992 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 16:58:38,078 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/java.io.tmpdir/Jetty_localhost_42247_hdfs____.jrhu8v/webapp 2023-08-25 16:58:38,220 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42247 2023-08-25 16:58:38,231 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-25 16:58:38,231 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-25 16:58:38,714 WARN [Listener at localhost/41217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 16:58:38,806 WARN [Listener at localhost/41217] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-25 16:58:38,829 WARN [Listener at localhost/41217] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 16:58:38,835 INFO [Listener at localhost/41217] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 16:58:38,840 INFO [Listener at localhost/41217] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/java.io.tmpdir/Jetty_localhost_44669_datanode____z4e82o/webapp 2023-08-25 16:58:38,948 INFO [Listener at localhost/41217] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44669 2023-08-25 16:58:39,264 WARN [Listener at localhost/42805] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 16:58:39,273 WARN [Listener at localhost/42805] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-25 16:58:39,276 WARN [Listener at localhost/42805] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 16:58:39,278 INFO [Listener at localhost/42805] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 16:58:39,283 INFO [Listener at localhost/42805] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/java.io.tmpdir/Jetty_localhost_35091_datanode____ai2tfx/webapp 2023-08-25 16:58:39,388 INFO [Listener at localhost/42805] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35091 2023-08-25 16:58:39,399 WARN [Listener at localhost/44623] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 16:58:39,737 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2d13a16804ee9ef8: Processing first storage report for DS-da073f57-8606-49c2-b45a-21c9238668f3 from datanode f22af196-fcc3-449f-a58d-6a8beb850f78 2023-08-25 16:58:39,738 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2d13a16804ee9ef8: from storage DS-da073f57-8606-49c2-b45a-21c9238668f3 node DatanodeRegistration(127.0.0.1:36683, datanodeUuid=f22af196-fcc3-449f-a58d-6a8beb850f78, infoPort=41387, infoSecurePort=0, ipcPort=42805, storageInfo=lv=-57;cid=testClusterID;nsid=1779249281;c=1692982717559), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-08-25 16:58:39,739 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfa46d86557e87ab1: Processing first storage report for DS-7ffe1eee-00ea-4e97-ae20-c37b7fa3ad27 from datanode 279bc623-34d8-492a-91af-7e7ee1ed5f21 2023-08-25 16:58:39,739 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfa46d86557e87ab1: from storage DS-7ffe1eee-00ea-4e97-ae20-c37b7fa3ad27 node DatanodeRegistration(127.0.0.1:41999, datanodeUuid=279bc623-34d8-492a-91af-7e7ee1ed5f21, infoPort=45039, infoSecurePort=0, ipcPort=44623, storageInfo=lv=-57;cid=testClusterID;nsid=1779249281;c=1692982717559), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:58:39,739 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2d13a16804ee9ef8: Processing first storage report for DS-66e0d23d-5c91-4fae-b0d7-6d0dc0ed183f from datanode f22af196-fcc3-449f-a58d-6a8beb850f78 2023-08-25 16:58:39,739 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2d13a16804ee9ef8: from storage DS-66e0d23d-5c91-4fae-b0d7-6d0dc0ed183f node DatanodeRegistration(127.0.0.1:36683, datanodeUuid=f22af196-fcc3-449f-a58d-6a8beb850f78, infoPort=41387, infoSecurePort=0, ipcPort=42805, storageInfo=lv=-57;cid=testClusterID;nsid=1779249281;c=1692982717559), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:58:39,739 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfa46d86557e87ab1: Processing first storage report for DS-0147d8ec-e523-415f-ba90-6fba1df58512 from datanode 279bc623-34d8-492a-91af-7e7ee1ed5f21 2023-08-25 16:58:39,739 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfa46d86557e87ab1: from storage DS-0147d8ec-e523-415f-ba90-6fba1df58512 node DatanodeRegistration(127.0.0.1:41999, datanodeUuid=279bc623-34d8-492a-91af-7e7ee1ed5f21, infoPort=45039, infoSecurePort=0, ipcPort=44623, storageInfo=lv=-57;cid=testClusterID;nsid=1779249281;c=1692982717559), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-25 16:58:39,812 DEBUG [Listener at localhost/44623] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345 2023-08-25 16:58:39,894 INFO [Listener at localhost/44623] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/zookeeper_0, clientPort=51780, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-25 16:58:39,913 INFO [Listener at localhost/44623] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51780 2023-08-25 16:58:39,924 INFO [Listener at localhost/44623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:58:39,927 INFO [Listener at localhost/44623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:58:40,606 INFO [Listener at localhost/44623] util.FSUtils(471): Created version file at hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a with version=8 2023-08-25 16:58:40,606 INFO [Listener at localhost/44623] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/hbase-staging 2023-08-25 16:58:40,972 INFO [Listener at localhost/44623] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-08-25 16:58:41,495 INFO [Listener at localhost/44623] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-25 16:58:41,527 INFO [Listener at localhost/44623] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 16:58:41,528 INFO [Listener at localhost/44623] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-25 16:58:41,528 INFO [Listener at localhost/44623] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-25 16:58:41,528 INFO [Listener at localhost/44623] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 16:58:41,529 INFO [Listener at localhost/44623] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-25 16:58:41,673 INFO [Listener at localhost/44623] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-25 16:58:41,757 DEBUG [Listener at localhost/44623] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-08-25 16:58:41,874 INFO [Listener at localhost/44623] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34935 2023-08-25 16:58:41,885 INFO [Listener at localhost/44623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:58:41,888 INFO [Listener at localhost/44623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:58:41,911 INFO [Listener at localhost/44623] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34935 connecting to ZooKeeper ensemble=127.0.0.1:51780 2023-08-25 16:58:41,964 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:349350x0, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-25 16:58:41,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34935-0x10044616d280000 connected 2023-08-25 16:58:42,001 DEBUG [Listener at localhost/44623] zookeeper.ZKUtil(164): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-25 16:58:42,002 DEBUG [Listener at localhost/44623] zookeeper.ZKUtil(164): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 16:58:42,005 DEBUG [Listener at localhost/44623] zookeeper.ZKUtil(164): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-25 16:58:42,017 DEBUG [Listener at localhost/44623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34935 2023-08-25 16:58:42,017 DEBUG [Listener at localhost/44623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34935 2023-08-25 16:58:42,018 DEBUG [Listener at localhost/44623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34935 2023-08-25 16:58:42,020 DEBUG [Listener at localhost/44623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34935 2023-08-25 16:58:42,020 DEBUG [Listener at localhost/44623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34935 2023-08-25 16:58:42,027 INFO [Listener at localhost/44623] master.HMaster(444): hbase.rootdir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a, hbase.cluster.distributed=false 2023-08-25 16:58:42,112 INFO [Listener at localhost/44623] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-25 16:58:42,112 INFO [Listener at localhost/44623] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 16:58:42,113 INFO [Listener at localhost/44623] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-25 16:58:42,113 INFO [Listener at localhost/44623] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-25 16:58:42,113 INFO [Listener at localhost/44623] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 16:58:42,113 INFO [Listener at localhost/44623] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-25 16:58:42,119 INFO [Listener at localhost/44623] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-25 16:58:42,122 INFO [Listener at localhost/44623] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34243 2023-08-25 16:58:42,124 INFO [Listener at localhost/44623] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-25 16:58:42,130 DEBUG [Listener at localhost/44623] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-25 16:58:42,131 INFO [Listener at localhost/44623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:58:42,133 INFO [Listener at localhost/44623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:58:42,135 INFO [Listener at localhost/44623] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34243 connecting to ZooKeeper ensemble=127.0.0.1:51780 2023-08-25 16:58:42,138 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): regionserver:342430x0, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-25 16:58:42,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34243-0x10044616d280001 connected 2023-08-25 16:58:42,139 DEBUG [Listener at localhost/44623] zookeeper.ZKUtil(164): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-25 16:58:42,140 DEBUG [Listener at localhost/44623] zookeeper.ZKUtil(164): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 16:58:42,141 DEBUG [Listener at localhost/44623] zookeeper.ZKUtil(164): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-25 16:58:42,142 DEBUG [Listener at localhost/44623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34243 2023-08-25 16:58:42,142 DEBUG [Listener at localhost/44623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34243 2023-08-25 16:58:42,143 DEBUG [Listener at localhost/44623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34243 2023-08-25 16:58:42,144 DEBUG [Listener at localhost/44623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34243 2023-08-25 16:58:42,144 DEBUG [Listener at localhost/44623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34243 2023-08-25 16:58:42,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34935,1692982720776 2023-08-25 16:58:42,155 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-25 16:58:42,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34935,1692982720776 2023-08-25 16:58:42,175 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-25 16:58:42,175 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-25 16:58:42,175 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:58:42,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-25 16:58:42,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34935,1692982720776 from backup master directory 2023-08-25 16:58:42,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-25 16:58:42,180 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34935,1692982720776 2023-08-25 16:58:42,180 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-25 16:58:42,181 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-25 16:58:42,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34935,1692982720776 2023-08-25 16:58:42,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-08-25 16:58:42,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-08-25 16:58:42,279 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/hbase.id with ID: f85db52c-8c92-4929-bfd5-cf1679d6e339 2023-08-25 16:58:42,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:58:42,335 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:58:42,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x71c116cf to 127.0.0.1:51780 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-25 16:58:42,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@445bdea8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-25 16:58:42,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-25 16:58:42,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-25 16:58:42,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 16:58:42,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/data/master/store-tmp 2023-08-25 16:58:42,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:58:42,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-25 16:58:42,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 16:58:42,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 16:58:42,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-25 16:58:42,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 16:58:42,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 16:58:42,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-25 16:58:42,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/WALs/jenkins-hbase4.apache.org,34935,1692982720776 2023-08-25 16:58:42,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34935%2C1692982720776, suffix=, logDir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/WALs/jenkins-hbase4.apache.org,34935,1692982720776, archiveDir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/oldWALs, maxLogs=10 2023-08-25 16:58:42,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-08-25 16:58:42,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-08-25 16:58:42,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:53) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:190) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:719) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:128) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:881) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:574) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:515) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:160) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:295) at org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:200) at org.apache.hadoop.hbase.master.region.MasterRegion.bootstrap(MasterRegion.java:220) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:348) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:42,644 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:417) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:42,646 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41999,DS-7ffe1eee-00ea-4e97-ae20-c37b7fa3ad27,DISK] 2023-08-25 16:58:42,646 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36683,DS-da073f57-8606-49c2-b45a-21c9238668f3,DISK] 2023-08-25 16:58:42,653 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:42,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/WALs/jenkins-hbase4.apache.org,34935,1692982720776/jenkins-hbase4.apache.org%2C34935%2C1692982720776.1692982722588 2023-08-25 16:58:42,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41999,DS-7ffe1eee-00ea-4e97-ae20-c37b7fa3ad27,DISK], DatanodeInfoWithStorage[127.0.0.1:36683,DS-da073f57-8606-49c2-b45a-21c9238668f3,DISK]] 2023-08-25 16:58:42,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-25 16:58:42,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:58:42,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-25 16:58:42,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-25 16:58:42,777 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-25 16:58:42,784 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-25 16:58:42,814 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-25 16:58:42,825 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:58:42,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-25 16:58:42,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-25 16:58:42,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-25 16:58:42,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 16:58:42,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=868739, jitterRate=0.10465987026691437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 16:58:42,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-25 16:58:42,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-25 16:58:42,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-25 16:58:42,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-25 16:58:42,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-25 16:58:42,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-08-25 16:58:42,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 30 msec 2023-08-25 16:58:42,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-25 16:58:42,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-25 16:58:42,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-25 16:58:42,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-25 16:58:42,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-25 16:58:42,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-25 16:58:42,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-25 16:58:42,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-25 16:58:42,980 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:58:42,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-25 16:58:42,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-25 16:58:42,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-25 16:58:43,000 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-25 16:58:43,000 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-25 16:58:43,000 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:58:43,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34935,1692982720776, sessionid=0x10044616d280000, setting cluster-up flag (Was=false) 2023-08-25 16:58:43,021 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:58:43,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-25 16:58:43,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34935,1692982720776 2023-08-25 16:58:43,037 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:58:43,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-25 16:58:43,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34935,1692982720776 2023-08-25 16:58:43,050 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/.hbase-snapshot/.tmp 2023-08-25 16:58:43,150 INFO [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(951): ClusterId : f85db52c-8c92-4929-bfd5-cf1679d6e339 2023-08-25 16:58:43,154 DEBUG [RS:0;jenkins-hbase4:34243] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-25 16:58:43,161 DEBUG [RS:0;jenkins-hbase4:34243] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-25 16:58:43,161 DEBUG [RS:0;jenkins-hbase4:34243] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-25 16:58:43,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-25 16:58:43,164 DEBUG [RS:0;jenkins-hbase4:34243] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-25 16:58:43,165 DEBUG [RS:0;jenkins-hbase4:34243] zookeeper.ReadOnlyZKClient(139): Connect 0x1a36d891 to 127.0.0.1:51780 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-25 16:58:43,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 16:58:43,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 16:58:43,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 16:58:43,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 16:58:43,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-25 16:58:43,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:58:43,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-25 16:58:43,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:58:43,179 DEBUG [RS:0;jenkins-hbase4:34243] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14f135a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-25 16:58:43,187 DEBUG [RS:0;jenkins-hbase4:34243] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10ceb3e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-25 16:58:43,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1692982753188 2023-08-25 16:58:43,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-25 16:58:43,200 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-25 16:58:43,201 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-25 16:58:43,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-25 16:58:43,211 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-25 16:58:43,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-25 16:58:43,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-25 16:58:43,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-25 16:58:43,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-25 16:58:43,224 DEBUG [RS:0;jenkins-hbase4:34243] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34243 2023-08-25 16:58:43,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-25 16:58:43,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-25 16:58:43,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-25 16:58:43,235 INFO [RS:0;jenkins-hbase4:34243] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-25 16:58:43,235 INFO [RS:0;jenkins-hbase4:34243] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-25 16:58:43,235 DEBUG [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1022): About to register with Master. 2023-08-25 16:58:43,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-25 16:58:43,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-25 16:58:43,238 INFO [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34935,1692982720776 with isa=jenkins-hbase4.apache.org/172.31.14.131:34243, startcode=1692982722111 2023-08-25 16:58:43,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1692982723240,5,FailOnTimeoutGroup] 2023-08-25 16:58:43,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1692982723241,5,FailOnTimeoutGroup] 2023-08-25 16:58:43,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-25 16:58:43,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,259 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-25 16:58:43,260 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-25 16:58:43,260 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a 2023-08-25 16:58:43,272 DEBUG [RS:0;jenkins-hbase4:34243] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-25 16:58:43,277 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:58:43,281 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-25 16:58:43,284 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/info 2023-08-25 16:58:43,286 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-25 16:58:43,287 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:58:43,287 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-25 16:58:43,290 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/rep_barrier 2023-08-25 16:58:43,291 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-25 16:58:43,292 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:58:43,292 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-25 16:58:43,295 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/table 2023-08-25 16:58:43,296 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-25 16:58:43,297 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:58:43,299 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740 2023-08-25 16:58:43,300 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740 2023-08-25 16:58:43,304 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-25 16:58:43,306 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-25 16:58:43,310 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 16:58:43,311 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=764444, jitterRate=-0.02795964479446411}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-25 16:58:43,311 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-25 16:58:43,312 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-25 16:58:43,312 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-25 16:58:43,312 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-25 16:58:43,312 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-25 16:58:43,312 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-25 16:58:43,313 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-25 16:58:43,313 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-25 16:58:43,319 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-25 16:58:43,320 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-25 16:58:43,329 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35055, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-08-25 16:58:43,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-25 16:58:43,342 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34935] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:43,348 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-25 16:58:43,354 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-25 16:58:43,362 DEBUG [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a 2023-08-25 16:58:43,363 DEBUG [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41217 2023-08-25 16:58:43,363 DEBUG [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-25 16:58:43,369 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-25 16:58:43,370 DEBUG [RS:0;jenkins-hbase4:34243] zookeeper.ZKUtil(162): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:43,370 WARN [RS:0;jenkins-hbase4:34243] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-25 16:58:43,371 INFO [RS:0;jenkins-hbase4:34243] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 16:58:43,371 DEBUG [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:43,375 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34243,1692982722111] 2023-08-25 16:58:43,383 DEBUG [RS:0;jenkins-hbase4:34243] zookeeper.ZKUtil(162): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:43,395 DEBUG [RS:0;jenkins-hbase4:34243] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-25 16:58:43,403 INFO [RS:0;jenkins-hbase4:34243] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-25 16:58:43,423 INFO [RS:0;jenkins-hbase4:34243] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-25 16:58:43,427 INFO [RS:0;jenkins-hbase4:34243] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-25 16:58:43,427 INFO [RS:0;jenkins-hbase4:34243] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,428 INFO [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-25 16:58:43,437 INFO [RS:0;jenkins-hbase4:34243] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,437 DEBUG [RS:0;jenkins-hbase4:34243] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:58:43,437 DEBUG [RS:0;jenkins-hbase4:34243] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:58:43,438 DEBUG [RS:0;jenkins-hbase4:34243] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:58:43,438 DEBUG [RS:0;jenkins-hbase4:34243] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:58:43,438 DEBUG [RS:0;jenkins-hbase4:34243] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:58:43,438 DEBUG [RS:0;jenkins-hbase4:34243] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-25 16:58:43,438 DEBUG [RS:0;jenkins-hbase4:34243] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:58:43,438 DEBUG [RS:0;jenkins-hbase4:34243] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:58:43,439 DEBUG [RS:0;jenkins-hbase4:34243] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:58:43,439 DEBUG [RS:0;jenkins-hbase4:34243] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:58:43,441 INFO [RS:0;jenkins-hbase4:34243] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,441 INFO [RS:0;jenkins-hbase4:34243] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,441 INFO [RS:0;jenkins-hbase4:34243] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,461 INFO [RS:0;jenkins-hbase4:34243] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-25 16:58:43,463 INFO [RS:0;jenkins-hbase4:34243] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34243,1692982722111-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,479 INFO [RS:0;jenkins-hbase4:34243] regionserver.Replication(203): jenkins-hbase4.apache.org,34243,1692982722111 started 2023-08-25 16:58:43,479 INFO [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34243,1692982722111, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34243, sessionid=0x10044616d280001 2023-08-25 16:58:43,479 DEBUG [RS:0;jenkins-hbase4:34243] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-25 16:58:43,479 DEBUG [RS:0;jenkins-hbase4:34243] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:43,479 DEBUG [RS:0;jenkins-hbase4:34243] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34243,1692982722111' 2023-08-25 16:58:43,480 DEBUG [RS:0;jenkins-hbase4:34243] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 16:58:43,480 DEBUG [RS:0;jenkins-hbase4:34243] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 16:58:43,481 DEBUG [RS:0;jenkins-hbase4:34243] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-25 16:58:43,481 DEBUG [RS:0;jenkins-hbase4:34243] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-25 16:58:43,481 DEBUG [RS:0;jenkins-hbase4:34243] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:43,481 DEBUG [RS:0;jenkins-hbase4:34243] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34243,1692982722111' 2023-08-25 16:58:43,481 DEBUG [RS:0;jenkins-hbase4:34243] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-25 16:58:43,482 DEBUG [RS:0;jenkins-hbase4:34243] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-25 16:58:43,482 DEBUG [RS:0;jenkins-hbase4:34243] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-25 16:58:43,482 INFO [RS:0;jenkins-hbase4:34243] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-25 16:58:43,482 INFO [RS:0;jenkins-hbase4:34243] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-25 16:58:43,506 DEBUG [jenkins-hbase4:34935] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-25 16:58:43,509 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34243,1692982722111, state=OPENING 2023-08-25 16:58:43,517 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-25 16:58:43,519 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:58:43,519 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-25 16:58:43,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34243,1692982722111}] 2023-08-25 16:58:43,593 INFO [RS:0;jenkins-hbase4:34243] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34243%2C1692982722111, suffix=, logDir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111, archiveDir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/oldWALs, maxLogs=32 2023-08-25 16:58:43,618 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41999,DS-7ffe1eee-00ea-4e97-ae20-c37b7fa3ad27,DISK] 2023-08-25 16:58:43,618 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36683,DS-da073f57-8606-49c2-b45a-21c9238668f3,DISK] 2023-08-25 16:58:43,622 INFO [RS:0;jenkins-hbase4:34243] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.1692982723597 2023-08-25 16:58:43,623 DEBUG [RS:0;jenkins-hbase4:34243] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41999,DS-7ffe1eee-00ea-4e97-ae20-c37b7fa3ad27,DISK], DatanodeInfoWithStorage[127.0.0.1:36683,DS-da073f57-8606-49c2-b45a-21c9238668f3,DISK]] 2023-08-25 16:58:43,711 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:43,714 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-25 16:58:43,719 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-25 16:58:43,734 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-25 16:58:43,735 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 16:58:43,739 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta, suffix=.meta, logDir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111, archiveDir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/oldWALs, maxLogs=32 2023-08-25 16:58:43,758 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36683,DS-da073f57-8606-49c2-b45a-21c9238668f3,DISK] 2023-08-25 16:58:43,761 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41999,DS-7ffe1eee-00ea-4e97-ae20-c37b7fa3ad27,DISK] 2023-08-25 16:58:43,765 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta.1692982723741.meta 2023-08-25 16:58:43,766 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36683,DS-da073f57-8606-49c2-b45a-21c9238668f3,DISK], DatanodeInfoWithStorage[127.0.0.1:41999,DS-7ffe1eee-00ea-4e97-ae20-c37b7fa3ad27,DISK]] 2023-08-25 16:58:43,766 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-25 16:58:43,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-25 16:58:43,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-25 16:58:43,788 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-25 16:58:43,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-25 16:58:43,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:58:43,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-25 16:58:43,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-25 16:58:43,796 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-25 16:58:43,798 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/info 2023-08-25 16:58:43,798 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/info 2023-08-25 16:58:43,799 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-25 16:58:43,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:58:43,800 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-25 16:58:43,801 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/rep_barrier 2023-08-25 16:58:43,801 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/rep_barrier 2023-08-25 16:58:43,802 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-25 16:58:43,803 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:58:43,803 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-25 16:58:43,804 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/table 2023-08-25 16:58:43,804 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/table 2023-08-25 16:58:43,805 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-25 16:58:43,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:58:43,807 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740 2023-08-25 16:58:43,810 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740 2023-08-25 16:58:43,813 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-25 16:58:43,815 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-25 16:58:43,816 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=729726, jitterRate=-0.07210563123226166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-25 16:58:43,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-25 16:58:43,826 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1692982723702 2023-08-25 16:58:43,841 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-25 16:58:43,842 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-25 16:58:43,843 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34243,1692982722111, state=OPEN 2023-08-25 16:58:43,845 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-25 16:58:43,845 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-25 16:58:43,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-25 16:58:43,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34243,1692982722111 in 321 msec 2023-08-25 16:58:43,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-25 16:58:43,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 530 msec 2023-08-25 16:58:43,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 776 msec 2023-08-25 16:58:43,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1692982723875, completionTime=-1 2023-08-25 16:58:43,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-25 16:58:43,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-25 16:58:43,941 DEBUG [hconnection-0x641167b7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-25 16:58:43,944 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-25 16:58:43,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-25 16:58:43,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1692982783960 2023-08-25 16:58:43,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1692982843960 2023-08-25 16:58:43,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 84 msec 2023-08-25 16:58:43,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34935,1692982720776-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34935,1692982720776-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34935,1692982720776-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34935, period=300000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-25 16:58:43,994 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-25 16:58:44,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-25 16:58:44,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-25 16:58:44,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-25 16:58:44,014 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-25 16:58:44,017 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-25 16:58:44,038 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/.tmp/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7 2023-08-25 16:58:44,040 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/.tmp/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7 empty. 2023-08-25 16:58:44,041 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/.tmp/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7 2023-08-25 16:58:44,041 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-25 16:58:44,068 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-25 16:58:44,070 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => b36057d18d4c026100368c538e8b87f7, NAME => 'hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/.tmp 2023-08-25 16:58:44,086 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:58:44,086 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing b36057d18d4c026100368c538e8b87f7, disabling compactions & flushes 2023-08-25 16:58:44,086 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. 2023-08-25 16:58:44,086 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. 2023-08-25 16:58:44,086 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. after waiting 0 ms 2023-08-25 16:58:44,086 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. 2023-08-25 16:58:44,086 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. 2023-08-25 16:58:44,086 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for b36057d18d4c026100368c538e8b87f7: 2023-08-25 16:58:44,091 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-25 16:58:44,105 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692982724093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692982724093"}]},"ts":"1692982724093"} 2023-08-25 16:58:44,129 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-25 16:58:44,131 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-25 16:58:44,135 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982724131"}]},"ts":"1692982724131"} 2023-08-25 16:58:44,138 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-25 16:58:44,148 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b36057d18d4c026100368c538e8b87f7, ASSIGN}] 2023-08-25 16:58:44,150 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b36057d18d4c026100368c538e8b87f7, ASSIGN 2023-08-25 16:58:44,152 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b36057d18d4c026100368c538e8b87f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34243,1692982722111; forceNewPlan=false, retain=false 2023-08-25 16:58:44,303 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b36057d18d4c026100368c538e8b87f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:44,303 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692982724302"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1692982724302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692982724302"}]},"ts":"1692982724302"} 2023-08-25 16:58:44,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b36057d18d4c026100368c538e8b87f7, server=jenkins-hbase4.apache.org,34243,1692982722111}] 2023-08-25 16:58:44,467 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. 2023-08-25 16:58:44,468 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b36057d18d4c026100368c538e8b87f7, NAME => 'hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7.', STARTKEY => '', ENDKEY => ''} 2023-08-25 16:58:44,469 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b36057d18d4c026100368c538e8b87f7 2023-08-25 16:58:44,469 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:58:44,469 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b36057d18d4c026100368c538e8b87f7 2023-08-25 16:58:44,469 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b36057d18d4c026100368c538e8b87f7 2023-08-25 16:58:44,471 INFO [StoreOpener-b36057d18d4c026100368c538e8b87f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b36057d18d4c026100368c538e8b87f7 2023-08-25 16:58:44,474 DEBUG [StoreOpener-b36057d18d4c026100368c538e8b87f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7/info 2023-08-25 16:58:44,474 DEBUG [StoreOpener-b36057d18d4c026100368c538e8b87f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7/info 2023-08-25 16:58:44,474 INFO [StoreOpener-b36057d18d4c026100368c538e8b87f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b36057d18d4c026100368c538e8b87f7 columnFamilyName info 2023-08-25 16:58:44,475 INFO [StoreOpener-b36057d18d4c026100368c538e8b87f7-1] regionserver.HStore(310): Store=b36057d18d4c026100368c538e8b87f7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:58:44,477 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7 2023-08-25 16:58:44,478 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7 2023-08-25 16:58:44,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b36057d18d4c026100368c538e8b87f7 2023-08-25 16:58:44,489 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 16:58:44,490 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b36057d18d4c026100368c538e8b87f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=875283, jitterRate=0.11298027634620667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 16:58:44,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b36057d18d4c026100368c538e8b87f7: 2023-08-25 16:58:44,492 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7., pid=6, masterSystemTime=1692982724461 2023-08-25 16:58:44,496 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. 2023-08-25 16:58:44,496 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. 2023-08-25 16:58:44,498 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b36057d18d4c026100368c538e8b87f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:44,498 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692982724497"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1692982724497"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692982724497"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692982724497"}]},"ts":"1692982724497"} 2023-08-25 16:58:44,508 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-25 16:58:44,508 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b36057d18d4c026100368c538e8b87f7, server=jenkins-hbase4.apache.org,34243,1692982722111 in 197 msec 2023-08-25 16:58:44,511 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-25 16:58:44,512 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b36057d18d4c026100368c538e8b87f7, ASSIGN in 360 msec 2023-08-25 16:58:44,513 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-25 16:58:44,513 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982724513"}]},"ts":"1692982724513"} 2023-08-25 16:58:44,516 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-25 16:58:44,519 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-25 16:58:44,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 515 msec 2023-08-25 16:58:44,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-25 16:58:44,617 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-25 16:58:44,617 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:58:44,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-25 16:58:44,667 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-25 16:58:44,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-08-25 16:58:44,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-25 16:58:44,697 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-25 16:58:44,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-08-25 16:58:44,710 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-25 16:58:44,713 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-25 16:58:44,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.532sec 2023-08-25 16:58:44,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-25 16:58:44,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-25 16:58:44,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-25 16:58:44,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34935,1692982720776-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-25 16:58:44,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34935,1692982720776-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-25 16:58:44,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-25 16:58:44,756 DEBUG [Listener at localhost/44623] zookeeper.ReadOnlyZKClient(139): Connect 0x6e2734be to 127.0.0.1:51780 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-25 16:58:44,761 DEBUG [Listener at localhost/44623] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38b4c282, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-25 16:58:44,811 DEBUG [hconnection-0x21c208bc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-25 16:58:44,822 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-25 16:58:44,833 INFO [Listener at localhost/44623] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34935,1692982720776 2023-08-25 16:58:44,833 INFO [Listener at localhost/44623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:58:44,841 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-25 16:58:44,841 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:58:44,842 INFO [Listener at localhost/44623] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-25 16:58:44,858 WARN [Listener at localhost/44623] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-25 16:58:44,861 WARN [Listener at localhost/44623] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 16:58:44,862 INFO [Listener at localhost/44623] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 16:58:44,868 INFO [Listener at localhost/44623] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/java.io.tmpdir/Jetty_localhost_37611_datanode____.2zuz3b/webapp 2023-08-25 16:58:44,966 INFO [Listener at localhost/44623] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37611 2023-08-25 16:58:44,975 WARN [Listener at localhost/32905] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 16:58:44,996 WARN [Listener at localhost/32905] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-25 16:58:44,999 WARN [Listener at localhost/32905] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 16:58:45,000 INFO [Listener at localhost/32905] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 16:58:45,005 INFO [Listener at localhost/32905] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/java.io.tmpdir/Jetty_localhost_46859_datanode____5fh535/webapp 2023-08-25 16:58:45,095 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x38b9e3c258aed683: Processing first storage report for DS-630ed1c0-e2ac-489d-b729-20cfdfcc4e49 from datanode 07d65345-438f-42cb-8e90-8e142fba4d7a 2023-08-25 16:58:45,095 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x38b9e3c258aed683: from storage DS-630ed1c0-e2ac-489d-b729-20cfdfcc4e49 node DatanodeRegistration(127.0.0.1:39243, datanodeUuid=07d65345-438f-42cb-8e90-8e142fba4d7a, infoPort=37911, infoSecurePort=0, ipcPort=32905, storageInfo=lv=-57;cid=testClusterID;nsid=1779249281;c=1692982717559), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:58:45,095 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x38b9e3c258aed683: Processing first storage report for DS-61ce77e5-ed0d-4aa5-8b1e-1f1165f0c5d1 from datanode 07d65345-438f-42cb-8e90-8e142fba4d7a 2023-08-25 16:58:45,095 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x38b9e3c258aed683: from storage DS-61ce77e5-ed0d-4aa5-8b1e-1f1165f0c5d1 node DatanodeRegistration(127.0.0.1:39243, datanodeUuid=07d65345-438f-42cb-8e90-8e142fba4d7a, infoPort=37911, infoSecurePort=0, ipcPort=32905, storageInfo=lv=-57;cid=testClusterID;nsid=1779249281;c=1692982717559), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:58:45,122 INFO [Listener at localhost/32905] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46859 2023-08-25 16:58:45,132 WARN [Listener at localhost/38625] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 16:58:45,150 WARN [Listener at localhost/38625] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-25 16:58:45,153 WARN [Listener at localhost/38625] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 16:58:45,154 INFO [Listener at localhost/38625] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 16:58:45,159 INFO [Listener at localhost/38625] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/java.io.tmpdir/Jetty_localhost_35057_datanode____etygbb/webapp 2023-08-25 16:58:45,247 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x571e67d57f6f7efd: Processing first storage report for DS-f3e580da-a400-448a-b718-4f62a6942f57 from datanode afce3af0-7725-4350-80a3-3e9af16385e4 2023-08-25 16:58:45,247 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x571e67d57f6f7efd: from storage DS-f3e580da-a400-448a-b718-4f62a6942f57 node DatanodeRegistration(127.0.0.1:34281, datanodeUuid=afce3af0-7725-4350-80a3-3e9af16385e4, infoPort=34095, infoSecurePort=0, ipcPort=38625, storageInfo=lv=-57;cid=testClusterID;nsid=1779249281;c=1692982717559), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:58:45,247 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x571e67d57f6f7efd: Processing first storage report for DS-78b00413-92cf-4a2a-8030-a75557fdbe2d from datanode afce3af0-7725-4350-80a3-3e9af16385e4 2023-08-25 16:58:45,248 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x571e67d57f6f7efd: from storage DS-78b00413-92cf-4a2a-8030-a75557fdbe2d node DatanodeRegistration(127.0.0.1:34281, datanodeUuid=afce3af0-7725-4350-80a3-3e9af16385e4, infoPort=34095, infoSecurePort=0, ipcPort=38625, storageInfo=lv=-57;cid=testClusterID;nsid=1779249281;c=1692982717559), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:58:45,270 INFO [Listener at localhost/38625] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35057 2023-08-25 16:58:45,281 WARN [Listener at localhost/42637] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 16:58:45,438 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x35620b01086d0086: Processing first storage report for DS-7c509d59-d054-475a-a1ef-3054bb14612e from datanode 9223198a-a200-49fb-89d3-fd1b21cfb3cb 2023-08-25 16:58:45,438 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x35620b01086d0086: from storage DS-7c509d59-d054-475a-a1ef-3054bb14612e node DatanodeRegistration(127.0.0.1:44195, datanodeUuid=9223198a-a200-49fb-89d3-fd1b21cfb3cb, infoPort=35173, infoSecurePort=0, ipcPort=42637, storageInfo=lv=-57;cid=testClusterID;nsid=1779249281;c=1692982717559), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:58:45,439 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x35620b01086d0086: Processing first storage report for DS-684bc437-6cfa-49f7-ba85-1843bcefb1a7 from datanode 9223198a-a200-49fb-89d3-fd1b21cfb3cb 2023-08-25 16:58:45,439 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x35620b01086d0086: from storage DS-684bc437-6cfa-49f7-ba85-1843bcefb1a7 node DatanodeRegistration(127.0.0.1:44195, datanodeUuid=9223198a-a200-49fb-89d3-fd1b21cfb3cb, infoPort=35173, infoSecurePort=0, ipcPort=42637, storageInfo=lv=-57;cid=testClusterID;nsid=1779249281;c=1692982717559), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:58:45,452 DEBUG [Listener at localhost/42637] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-25 16:58:45,455 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-25 16:58:45,466 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34935] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-25 16:58:45,466 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34935] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-25 16:58:45,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34935] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-25 16:58:45,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34935] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath 2023-08-25 16:58:45,474 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_PRE_OPERATION 2023-08-25 16:58:45,476 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-25 16:58:45,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34935] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRollOnDatanodeDeath" procId is: 9 2023-08-25 16:58:45,479 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3 2023-08-25 16:58:45,481 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3 empty. 2023-08-25 16:58:45,483 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3 2023-08-25 16:58:45,484 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRollOnDatanodeDeath regions 2023-08-25 16:58:45,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34935] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-25 16:58:45,506 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/.tabledesc/.tableinfo.0000000001 2023-08-25 16:58:45,507 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4053eeda80085ec4a961f1accddf92d3, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/.tmp 2023-08-25 16:58:45,523 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:58:45,523 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1604): Closing 4053eeda80085ec4a961f1accddf92d3, disabling compactions & flushes 2023-08-25 16:58:45,523 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:45,523 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:45,523 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. after waiting 0 ms 2023-08-25 16:58:45,523 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:45,523 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:45,523 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1558): Region close journal for 4053eeda80085ec4a961f1accddf92d3: 2023-08-25 16:58:45,527 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ADD_TO_META 2023-08-25 16:58:45,529 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1692982725528"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692982725528"}]},"ts":"1692982725528"} 2023-08-25 16:58:45,531 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-25 16:58:45,533 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-25 16:58:45,533 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982725533"}]},"ts":"1692982725533"} 2023-08-25 16:58:45,535 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLING in hbase:meta 2023-08-25 16:58:45,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=4053eeda80085ec4a961f1accddf92d3, ASSIGN}] 2023-08-25 16:58:45,542 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=4053eeda80085ec4a961f1accddf92d3, ASSIGN 2023-08-25 16:58:45,544 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=4053eeda80085ec4a961f1accddf92d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34243,1692982722111; forceNewPlan=false, retain=false 2023-08-25 16:58:45,695 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4053eeda80085ec4a961f1accddf92d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:45,696 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1692982725695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1692982725695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692982725695"}]},"ts":"1692982725695"} 2023-08-25 16:58:45,699 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 4053eeda80085ec4a961f1accddf92d3, server=jenkins-hbase4.apache.org,34243,1692982722111}] 2023-08-25 16:58:45,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:45,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4053eeda80085ec4a961f1accddf92d3, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3.', STARTKEY => '', ENDKEY => ''} 2023-08-25 16:58:45,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRollOnDatanodeDeath 4053eeda80085ec4a961f1accddf92d3 2023-08-25 16:58:45,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:58:45,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4053eeda80085ec4a961f1accddf92d3 2023-08-25 16:58:45,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4053eeda80085ec4a961f1accddf92d3 2023-08-25 16:58:45,862 INFO [StoreOpener-4053eeda80085ec4a961f1accddf92d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4053eeda80085ec4a961f1accddf92d3 2023-08-25 16:58:45,864 DEBUG [StoreOpener-4053eeda80085ec4a961f1accddf92d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3/info 2023-08-25 16:58:45,865 DEBUG [StoreOpener-4053eeda80085ec4a961f1accddf92d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3/info 2023-08-25 16:58:45,865 INFO [StoreOpener-4053eeda80085ec4a961f1accddf92d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4053eeda80085ec4a961f1accddf92d3 columnFamilyName info 2023-08-25 16:58:45,866 INFO [StoreOpener-4053eeda80085ec4a961f1accddf92d3-1] regionserver.HStore(310): Store=4053eeda80085ec4a961f1accddf92d3/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:58:45,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3 2023-08-25 16:58:45,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3 2023-08-25 16:58:45,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4053eeda80085ec4a961f1accddf92d3 2023-08-25 16:58:45,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 16:58:45,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4053eeda80085ec4a961f1accddf92d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=764610, jitterRate=-0.0277482271194458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 16:58:45,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4053eeda80085ec4a961f1accddf92d3: 2023-08-25 16:58:45,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3., pid=11, masterSystemTime=1692982725852 2023-08-25 16:58:45,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:45,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:45,885 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4053eeda80085ec4a961f1accddf92d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:45,885 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1692982725885"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1692982725885"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692982725885"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692982725885"}]},"ts":"1692982725885"} 2023-08-25 16:58:45,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-25 16:58:45,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 4053eeda80085ec4a961f1accddf92d3, server=jenkins-hbase4.apache.org,34243,1692982722111 in 189 msec 2023-08-25 16:58:45,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-25 16:58:45,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=4053eeda80085ec4a961f1accddf92d3, ASSIGN in 352 msec 2023-08-25 16:58:45,896 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-25 16:58:45,897 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982725897"}]},"ts":"1692982725897"} 2023-08-25 16:58:45,899 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLED in hbase:meta 2023-08-25 16:58:45,902 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_POST_OPERATION 2023-08-25 16:58:45,904 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath in 432 msec 2023-08-25 16:58:49,316 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-25 16:58:49,403 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-25 16:58:49,405 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-25 16:58:49,406 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRollOnDatanodeDeath' 2023-08-25 16:58:50,968 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-25 16:58:50,968 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-08-25 16:58:55,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34935] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-25 16:58:55,497 INFO [Listener at localhost/42637] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRollOnDatanodeDeath, procId: 9 completed 2023-08-25 16:58:55,497 DEBUG [Listener at localhost/42637] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestLogRolling-testLogRollOnDatanodeDeath get assigned. Timeout = 60000ms 2023-08-25 16:58:55,499 INFO [Listener at localhost/42637] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-08-25 16:58:55,504 INFO [Listener at localhost/42637] hbase.HBaseTestingUtility(3484): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned to meta. Checking AM states. 2023-08-25 16:58:55,504 INFO [Listener at localhost/42637] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-08-25 16:58:55,504 INFO [Listener at localhost/42637] hbase.HBaseTestingUtility(3504): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned. 2023-08-25 16:58:55,514 DEBUG [Listener at localhost/42637] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRollOnDatanodeDeath 2023-08-25 16:58:55,516 DEBUG [Listener at localhost/42637] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:55,516 WARN [Listener at localhost/42637] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-25 16:58:55,519 INFO [Listener at localhost/42637] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 16:58:55,524 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-82960586_17 at /127.0.0.1:47240 [Receiving block BP-1753136811-172.31.14.131-1692982717559:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:36683:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:47240 dst: /127.0.0.1:36683 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:55,524 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-82960586_17 at /127.0.0.1:47230 [Receiving block BP-1753136811-172.31.14.131-1692982717559:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:36683:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:47230 dst: /127.0.0.1:36683 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:55,524 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1424079945_17 at /127.0.0.1:47202 [Receiving block BP-1753136811-172.31.14.131-1692982717559:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:36683:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:47202 dst: /127.0.0.1:36683 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:55,621 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1424079945_17 at /127.0.0.1:39502 [Receiving block BP-1753136811-172.31.14.131-1692982717559:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:41999:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:39502 dst: /127.0.0.1:41999 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:55,622 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-82960586_17 at /127.0.0.1:39534 [Receiving block BP-1753136811-172.31.14.131-1692982717559:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:41999:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:39534 dst: /127.0.0.1:41999 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:55,624 WARN [BP-1753136811-172.31.14.131-1692982717559 heartbeating to localhost/127.0.0.1:41217] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-25 16:58:55,622 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-82960586_17 at /127.0.0.1:39546 [Receiving block BP-1753136811-172.31.14.131-1692982717559:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:41999:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:39546 dst: /127.0.0.1:41999 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:55,624 WARN [BP-1753136811-172.31.14.131-1692982717559 heartbeating to localhost/127.0.0.1:41217] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1753136811-172.31.14.131-1692982717559 (Datanode Uuid 279bc623-34d8-492a-91af-7e7ee1ed5f21) service to localhost/127.0.0.1:41217 2023-08-25 16:58:55,626 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/dfs/data/data3/current/BP-1753136811-172.31.14.131-1692982717559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 16:58:55,627 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/dfs/data/data4/current/BP-1753136811-172.31.14.131-1692982717559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 16:58:55,634 WARN [Listener at localhost/42637] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-25 16:58:55,637 WARN [Listener at localhost/42637] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 16:58:55,638 INFO [Listener at localhost/42637] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 16:58:55,642 INFO [Listener at localhost/42637] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/java.io.tmpdir/Jetty_localhost_42487_datanode____.4vfc10/webapp 2023-08-25 16:58:55,733 INFO [Listener at localhost/42637] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42487 2023-08-25 16:58:55,745 WARN [Listener at localhost/43405] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 16:58:55,749 WARN [AsyncFSWAL-0-hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a-prefix:jenkins-hbase4.apache.org,34243,1692982722111] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:55,750 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C34243%2C1692982722111:(num 1692982723597) roll requested 2023-08-25 16:58:55,767 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44195,DS-7c509d59-d054-475a-a1ef-3054bb14612e,DISK] 2023-08-25 16:58:55,768 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34281,DS-f3e580da-a400-448a-b718-4f62a6942f57,DISK] 2023-08-25 16:58:55,774 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.1692982723597 with entries=6, filesize=3.19 KB; new WAL /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.1692982735750 2023-08-25 16:58:55,777 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44195,DS-7c509d59-d054-475a-a1ef-3054bb14612e,DISK], DatanodeInfoWithStorage[127.0.0.1:34281,DS-f3e580da-a400-448a-b718-4f62a6942f57,DISK]] 2023-08-25 16:58:55,777 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.1692982723597 is not closed yet, will try archiving it next time 2023-08-25 16:58:55,779 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:55,779 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:55,781 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.1692982723597 2023-08-25 16:58:55,782 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-25 16:58:55,782 INFO [Listener at localhost/43405] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-25 16:58:55,786 DEBUG [Listener at localhost/43405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e2734be to 127.0.0.1:51780 2023-08-25 16:58:55,786 DEBUG [Listener at localhost/43405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 16:58:55,787 DEBUG [Listener at localhost/43405] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-25 16:58:55,787 DEBUG [Listener at localhost/43405] util.JVMClusterUtil(257): Found active master hash=1141152862, stopped=false 2023-08-25 16:58:55,787 WARN [IPC Server handler 3 on default port 41217] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.1692982723597 has not been closed. Lease recovery is in progress. RecoveryId = 1015 for block blk_1073741832_1008 2023-08-25 16:58:55,787 INFO [Listener at localhost/43405] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34935,1692982720776 2023-08-25 16:58:55,789 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-25 16:58:55,789 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:58:55,789 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-25 16:58:55,789 INFO [Listener at localhost/43405] procedure2.ProcedureExecutor(629): Stopping 2023-08-25 16:58:55,790 DEBUG [Listener at localhost/43405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71c116cf to 127.0.0.1:51780 2023-08-25 16:58:55,791 DEBUG [Listener at localhost/43405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 16:58:55,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 16:58:55,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 16:58:55,791 INFO [Listener at localhost/43405] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34243,1692982722111' ***** 2023-08-25 16:58:55,792 INFO [Listener at localhost/43405] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-25 16:58:55,792 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.1692982723597 after 11ms 2023-08-25 16:58:55,792 INFO [RS:0;jenkins-hbase4:34243] regionserver.HeapMemoryManager(220): Stopping 2023-08-25 16:58:55,792 INFO [RS:0;jenkins-hbase4:34243] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-25 16:58:55,792 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-25 16:58:55,792 INFO [RS:0;jenkins-hbase4:34243] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-25 16:58:55,793 INFO [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(3305): Received CLOSE for b36057d18d4c026100368c538e8b87f7 2023-08-25 16:58:55,794 INFO [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(3305): Received CLOSE for 4053eeda80085ec4a961f1accddf92d3 2023-08-25 16:58:55,795 INFO [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:55,795 DEBUG [RS:0;jenkins-hbase4:34243] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a36d891 to 127.0.0.1:51780 2023-08-25 16:58:55,795 DEBUG [RS:0;jenkins-hbase4:34243] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 16:58:55,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b36057d18d4c026100368c538e8b87f7, disabling compactions & flushes 2023-08-25 16:58:55,797 INFO [RS:0;jenkins-hbase4:34243] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-25 16:58:55,797 INFO [RS:0;jenkins-hbase4:34243] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-25 16:58:55,797 INFO [RS:0;jenkins-hbase4:34243] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-25 16:58:55,797 INFO [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-25 16:58:55,798 INFO [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-08-25 16:58:55,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. 2023-08-25 16:58:55,798 DEBUG [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, b36057d18d4c026100368c538e8b87f7=hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7., 4053eeda80085ec4a961f1accddf92d3=TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3.} 2023-08-25 16:58:55,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. 2023-08-25 16:58:55,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. after waiting 0 ms 2023-08-25 16:58:55,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. 2023-08-25 16:58:55,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b36057d18d4c026100368c538e8b87f7 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-25 16:58:55,799 DEBUG [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1504): Waiting on 1588230740, 4053eeda80085ec4a961f1accddf92d3, b36057d18d4c026100368c538e8b87f7 2023-08-25 16:58:55,801 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-25 16:58:55,801 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-25 16:58:55,801 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-25 16:58:55,801 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-25 16:58:55,802 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-25 16:58:55,802 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.92 KB heapSize=5.45 KB 2023-08-25 16:58:55,813 WARN [AsyncFSWAL-0-hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a-prefix:jenkins-hbase4.apache.org,34243,1692982722111.meta] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:55,815 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta:.meta(num 1692982723741) roll requested 2023-08-25 16:58:55,844 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34281,DS-f3e580da-a400-448a-b718-4f62a6942f57,DISK] 2023-08-25 16:58:55,854 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44195,DS-7c509d59-d054-475a-a1ef-3054bb14612e,DISK] 2023-08-25 16:58:55,862 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta.1692982723741.meta with entries=12, filesize=3.87 KB; new WAL /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta.1692982735815.meta 2023-08-25 16:58:55,862 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34281,DS-f3e580da-a400-448a-b718-4f62a6942f57,DISK], DatanodeInfoWithStorage[127.0.0.1:44195,DS-7c509d59-d054-475a-a1ef-3054bb14612e,DISK]] 2023-08-25 16:58:55,862 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta.1692982723741.meta is not closed yet, will try archiving it next time 2023-08-25 16:58:55,866 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:55,867 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:55,870 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta.1692982723741.meta 2023-08-25 16:58:55,871 WARN [IPC Server handler 3 on default port 41217] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta.1692982723741.meta has not been closed. Lease recovery is in progress. RecoveryId = 1017 for block blk_1073741833_1009 2023-08-25 16:58:55,872 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta.1692982723741.meta after 2ms 2023-08-25 16:58:55,920 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.69 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/.tmp/info/715ff62db62049068fd0f5500350603d 2023-08-25 16:58:55,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7/.tmp/info/4df613bff3e542d38b4d58a6cf51a021 2023-08-25 16:58:55,935 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x44f3f95bfc2736e0: Processing first storage report for DS-7ffe1eee-00ea-4e97-ae20-c37b7fa3ad27 from datanode 279bc623-34d8-492a-91af-7e7ee1ed5f21 2023-08-25 16:58:55,937 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x44f3f95bfc2736e0: from storage DS-7ffe1eee-00ea-4e97-ae20-c37b7fa3ad27 node DatanodeRegistration(127.0.0.1:43923, datanodeUuid=279bc623-34d8-492a-91af-7e7ee1ed5f21, infoPort=35943, infoSecurePort=0, ipcPort=43405, storageInfo=lv=-57;cid=testClusterID;nsid=1779249281;c=1692982717559), blocks: 6, hasStaleStorage: false, processing time: 2 msecs, invalidatedBlocks: 0 2023-08-25 16:58:55,937 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x44f3f95bfc2736e0: Processing first storage report for DS-0147d8ec-e523-415f-ba90-6fba1df58512 from datanode 279bc623-34d8-492a-91af-7e7ee1ed5f21 2023-08-25 16:58:55,937 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x44f3f95bfc2736e0: from storage DS-0147d8ec-e523-415f-ba90-6fba1df58512 node DatanodeRegistration(127.0.0.1:43923, datanodeUuid=279bc623-34d8-492a-91af-7e7ee1ed5f21, infoPort=35943, infoSecurePort=0, ipcPort=43405, storageInfo=lv=-57;cid=testClusterID;nsid=1779249281;c=1692982717559), blocks: 6, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:58:55,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7/.tmp/info/4df613bff3e542d38b4d58a6cf51a021 as hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7/info/4df613bff3e542d38b4d58a6cf51a021 2023-08-25 16:58:55,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7/info/4df613bff3e542d38b4d58a6cf51a021, entries=2, sequenceid=6, filesize=4.8 K 2023-08-25 16:58:55,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b36057d18d4c026100368c538e8b87f7 in 196ms, sequenceid=6, compaction requested=false 2023-08-25 16:58:55,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=240 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/.tmp/table/69820f10f5a846bb9cf8eb7e934b449d 2023-08-25 16:58:56,000 DEBUG [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1504): Waiting on 1588230740, 4053eeda80085ec4a961f1accddf92d3, b36057d18d4c026100368c538e8b87f7 2023-08-25 16:58:56,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/namespace/b36057d18d4c026100368c538e8b87f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-25 16:58:56,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. 2023-08-25 16:58:56,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b36057d18d4c026100368c538e8b87f7: 2023-08-25 16:58:56,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1692982724002.b36057d18d4c026100368c538e8b87f7. 2023-08-25 16:58:56,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4053eeda80085ec4a961f1accddf92d3, disabling compactions & flushes 2023-08-25 16:58:56,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:56,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:56,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. after waiting 0 ms 2023-08-25 16:58:56,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:56,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4053eeda80085ec4a961f1accddf92d3 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-08-25 16:58:56,016 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/.tmp/info/715ff62db62049068fd0f5500350603d as hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/info/715ff62db62049068fd0f5500350603d 2023-08-25 16:58:56,026 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/info/715ff62db62049068fd0f5500350603d, entries=20, sequenceid=14, filesize=7.4 K 2023-08-25 16:58:56,029 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/.tmp/table/69820f10f5a846bb9cf8eb7e934b449d as hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/table/69820f10f5a846bb9cf8eb7e934b449d 2023-08-25 16:58:56,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3/.tmp/info/9ecb8aad88304bd2b367ec435ad34afe 2023-08-25 16:58:56,042 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/table/69820f10f5a846bb9cf8eb7e934b449d, entries=4, sequenceid=14, filesize=4.8 K 2023-08-25 16:58:56,045 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.92 KB/2994, heapSize ~5.16 KB/5288, currentSize=0 B/0 for 1588230740 in 243ms, sequenceid=14, compaction requested=false 2023-08-25 16:58:56,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3/.tmp/info/9ecb8aad88304bd2b367ec435ad34afe as hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3/info/9ecb8aad88304bd2b367ec435ad34afe 2023-08-25 16:58:56,056 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-08-25 16:58:56,057 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-25 16:58:56,057 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-25 16:58:56,057 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-25 16:58:56,058 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-25 16:58:56,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3/info/9ecb8aad88304bd2b367ec435ad34afe, entries=2, sequenceid=6, filesize=6.8 K 2023-08-25 16:58:56,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for 4053eeda80085ec4a961f1accddf92d3 in 54ms, sequenceid=6, compaction requested=false 2023-08-25 16:58:56,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/data/default/TestLogRolling-testLogRollOnDatanodeDeath/4053eeda80085ec4a961f1accddf92d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-25 16:58:56,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:56,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4053eeda80085ec4a961f1accddf92d3: 2023-08-25 16:58:56,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1692982725466.4053eeda80085ec4a961f1accddf92d3. 2023-08-25 16:58:56,201 INFO [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34243,1692982722111; all regions closed. 2023-08-25 16:58:56,454 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-25 16:58:56,454 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-25 16:58:57,445 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-25 16:58:59,793 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.1692982723597 after 4012ms 2023-08-25 16:58:59,794 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.1692982723597 to hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/oldWALs/jenkins-hbase4.apache.org%2C34243%2C1692982722111.1692982723597 2023-08-25 16:58:59,873 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta.1692982723741.meta after 4003ms 2023-08-25 16:58:59,874 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/WALs/jenkins-hbase4.apache.org,34243,1692982722111/jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta.1692982723741.meta to hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/oldWALs/jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta.1692982723741.meta 2023-08-25 16:58:59,881 DEBUG [RS:0;jenkins-hbase4:34243] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/oldWALs 2023-08-25 16:58:59,881 INFO [RS:0;jenkins-hbase4:34243] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34243%2C1692982722111.meta:.meta(num 1692982735815) 2023-08-25 16:58:59,892 DEBUG [RS:0;jenkins-hbase4:34243] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/oldWALs 2023-08-25 16:58:59,892 INFO [RS:0;jenkins-hbase4:34243] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34243%2C1692982722111:(num 1692982735750) 2023-08-25 16:58:59,892 DEBUG [RS:0;jenkins-hbase4:34243] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 16:58:59,892 INFO [RS:0;jenkins-hbase4:34243] regionserver.LeaseManager(133): Closed leases 2023-08-25 16:58:59,893 INFO [RS:0;jenkins-hbase4:34243] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-25 16:58:59,893 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-25 16:58:59,894 INFO [RS:0;jenkins-hbase4:34243] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34243 2023-08-25 16:58:59,900 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34243,1692982722111 2023-08-25 16:58:59,900 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-25 16:58:59,901 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-25 16:58:59,902 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34243,1692982722111] 2023-08-25 16:58:59,902 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34243,1692982722111; numProcessing=1 2023-08-25 16:58:59,904 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34243,1692982722111 already deleted, retry=false 2023-08-25 16:58:59,905 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34243,1692982722111 expired; onlineServers=0 2023-08-25 16:58:59,905 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34935,1692982720776' ***** 2023-08-25 16:58:59,905 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-25 16:58:59,905 DEBUG [M:0;jenkins-hbase4:34935] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5399665, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-25 16:58:59,905 INFO [M:0;jenkins-hbase4:34935] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34935,1692982720776 2023-08-25 16:58:59,905 INFO [M:0;jenkins-hbase4:34935] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34935,1692982720776; all regions closed. 2023-08-25 16:58:59,906 DEBUG [M:0;jenkins-hbase4:34935] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 16:58:59,906 DEBUG [M:0;jenkins-hbase4:34935] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-25 16:58:59,906 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-25 16:58:59,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1692982723240] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1692982723240,5,FailOnTimeoutGroup] 2023-08-25 16:58:59,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1692982723241] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1692982723241,5,FailOnTimeoutGroup] 2023-08-25 16:58:59,906 DEBUG [M:0;jenkins-hbase4:34935] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-25 16:58:59,908 INFO [M:0;jenkins-hbase4:34935] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-25 16:58:59,908 INFO [M:0;jenkins-hbase4:34935] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-25 16:58:59,908 INFO [M:0;jenkins-hbase4:34935] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-25 16:58:59,908 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-25 16:58:59,908 DEBUG [M:0;jenkins-hbase4:34935] master.HMaster(1512): Stopping service threads 2023-08-25 16:58:59,908 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:58:59,909 INFO [M:0;jenkins-hbase4:34935] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-25 16:58:59,909 ERROR [M:0;jenkins-hbase4:34935] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] 2023-08-25 16:58:59,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master Thread[HFileArchiver-2,5,PEWorkerGroup] 2023-08-25 16:58:59,910 INFO [M:0;jenkins-hbase4:34935] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-25 16:58:59,910 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-25 16:58:59,910 DEBUG [M:0;jenkins-hbase4:34935] zookeeper.ZKUtil(398): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-25 16:58:59,910 WARN [M:0;jenkins-hbase4:34935] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-25 16:58:59,910 INFO [M:0;jenkins-hbase4:34935] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-25 16:58:59,911 INFO [M:0;jenkins-hbase4:34935] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-25 16:58:59,911 DEBUG [M:0;jenkins-hbase4:34935] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-25 16:58:59,911 INFO [M:0;jenkins-hbase4:34935] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 16:58:59,911 DEBUG [M:0;jenkins-hbase4:34935] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 16:58:59,911 DEBUG [M:0;jenkins-hbase4:34935] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-25 16:58:59,911 DEBUG [M:0;jenkins-hbase4:34935] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 16:58:59,912 INFO [M:0;jenkins-hbase4:34935] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.09 KB heapSize=45.73 KB 2023-08-25 16:58:59,912 WARN [AsyncFSWAL-0-hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData-prefix:jenkins-hbase4.apache.org,34935,1692982720776] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:59,913 DEBUG [master:store-WAL-Roller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C34935%2C1692982720776:(num 1692982722588) roll requested 2023-08-25 16:58:59,930 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44195,DS-7c509d59-d054-475a-a1ef-3054bb14612e,DISK] 2023-08-25 16:58:59,930 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34281,DS-f3e580da-a400-448a-b718-4f62a6942f57,DISK] 2023-08-25 16:58:59,934 INFO [master:store-WAL-Roller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/WALs/jenkins-hbase4.apache.org,34935,1692982720776/jenkins-hbase4.apache.org%2C34935%2C1692982720776.1692982722588 with entries=89, filesize=43.94 KB; new WAL /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/WALs/jenkins-hbase4.apache.org,34935,1692982720776/jenkins-hbase4.apache.org%2C34935%2C1692982720776.1692982739913 2023-08-25 16:58:59,935 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44195,DS-7c509d59-d054-475a-a1ef-3054bb14612e,DISK], DatanodeInfoWithStorage[127.0.0.1:34281,DS-f3e580da-a400-448a-b718-4f62a6942f57,DISK]] 2023-08-25 16:58:59,935 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(716): hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/WALs/jenkins-hbase4.apache.org,34935,1692982720776/jenkins-hbase4.apache.org%2C34935%2C1692982720776.1692982722588 is not closed yet, will try archiving it next time 2023-08-25 16:58:59,935 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:59,936 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-25 16:58:59,936 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/WALs/jenkins-hbase4.apache.org,34935,1692982720776/jenkins-hbase4.apache.org%2C34935%2C1692982720776.1692982722588 2023-08-25 16:58:59,937 WARN [IPC Server handler 4 on default port 41217] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/WALs/jenkins-hbase4.apache.org,34935,1692982720776/jenkins-hbase4.apache.org%2C34935%2C1692982720776.1692982722588 has not been closed. Lease recovery is in progress. RecoveryId = 1023 for block blk_1073741829_1005 2023-08-25 16:58:59,938 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/WALs/jenkins-hbase4.apache.org,34935,1692982720776/jenkins-hbase4.apache.org%2C34935%2C1692982720776.1692982722588 after 2ms 2023-08-25 16:58:59,958 INFO [M:0;jenkins-hbase4:34935] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.09 KB at sequenceid=91 (bloomFilter=true), to=hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/48e41f13fdcf4e14985446386dbc49e0 2023-08-25 16:58:59,977 DEBUG [M:0;jenkins-hbase4:34935] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/48e41f13fdcf4e14985446386dbc49e0 as hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/48e41f13fdcf4e14985446386dbc49e0 2023-08-25 16:58:59,986 INFO [M:0;jenkins-hbase4:34935] regionserver.HStore(1080): Added hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/48e41f13fdcf4e14985446386dbc49e0, entries=11, sequenceid=91, filesize=7.0 K 2023-08-25 16:58:59,987 INFO [M:0;jenkins-hbase4:34935] regionserver.HRegion(2948): Finished flush of dataSize ~38.09 KB/39009, heapSize ~45.72 KB/46816, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 76ms, sequenceid=91, compaction requested=false 2023-08-25 16:58:59,992 INFO [M:0;jenkins-hbase4:34935] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 16:58:59,992 DEBUG [M:0;jenkins-hbase4:34935] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-25 16:59:00,002 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 16:59:00,002 INFO [RS:0;jenkins-hbase4:34243] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34243,1692982722111; zookeeper connection closed. 2023-08-25 16:59:00,002 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): regionserver:34243-0x10044616d280001, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 16:59:00,003 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@68c4ed37] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@68c4ed37 2023-08-25 16:59:00,003 INFO [Listener at localhost/43405] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-25 16:59:00,967 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-25 16:59:01,560 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-25 16:59:03,938 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/WALs/jenkins-hbase4.apache.org,34935,1692982720776/jenkins-hbase4.apache.org%2C34935%2C1692982720776.1692982722588 after 4002ms 2023-08-25 16:59:03,939 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/WALs/jenkins-hbase4.apache.org,34935,1692982720776/jenkins-hbase4.apache.org%2C34935%2C1692982720776.1692982722588 to hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/oldWALs/jenkins-hbase4.apache.org%2C34935%2C1692982720776.1692982722588 2023-08-25 16:59:03,946 INFO [WAL-Archive-0] region.MasterRegionUtils(50): Moved hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/MasterData/oldWALs/jenkins-hbase4.apache.org%2C34935%2C1692982720776.1692982722588 to hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/oldWALs/jenkins-hbase4.apache.org%2C34935%2C1692982720776.1692982722588$masterlocalwal$ 2023-08-25 16:59:03,946 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-25 16:59:03,946 INFO [M:0;jenkins-hbase4:34935] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-25 16:59:03,947 INFO [M:0;jenkins-hbase4:34935] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34935 2023-08-25 16:59:03,950 DEBUG [M:0;jenkins-hbase4:34935] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34935,1692982720776 already deleted, retry=false 2023-08-25 16:59:04,051 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 16:59:04,051 INFO [M:0;jenkins-hbase4:34935] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34935,1692982720776; zookeeper connection closed. 2023-08-25 16:59:04,052 DEBUG [Listener at localhost/44623-EventThread] zookeeper.ZKWatcher(600): master:34935-0x10044616d280000, quorum=127.0.0.1:51780, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 16:59:04,054 WARN [Listener at localhost/43405] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-25 16:59:04,058 INFO [Listener at localhost/43405] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 16:59:04,162 WARN [BP-1753136811-172.31.14.131-1692982717559 heartbeating to localhost/127.0.0.1:41217] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-25 16:59:04,162 WARN [BP-1753136811-172.31.14.131-1692982717559 heartbeating to localhost/127.0.0.1:41217] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1753136811-172.31.14.131-1692982717559 (Datanode Uuid 279bc623-34d8-492a-91af-7e7ee1ed5f21) service to localhost/127.0.0.1:41217 2023-08-25 16:59:04,163 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/dfs/data/data3/current/BP-1753136811-172.31.14.131-1692982717559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 16:59:04,163 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/dfs/data/data4/current/BP-1753136811-172.31.14.131-1692982717559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 16:59:04,165 WARN [Listener at localhost/43405] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-25 16:59:04,168 INFO [Listener at localhost/43405] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 16:59:04,273 WARN [BP-1753136811-172.31.14.131-1692982717559 heartbeating to localhost/127.0.0.1:41217] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-25 16:59:04,273 WARN [BP-1753136811-172.31.14.131-1692982717559 heartbeating to localhost/127.0.0.1:41217] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1753136811-172.31.14.131-1692982717559 (Datanode Uuid 9223198a-a200-49fb-89d3-fd1b21cfb3cb) service to localhost/127.0.0.1:41217 2023-08-25 16:59:04,274 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/dfs/data/data10/current/BP-1753136811-172.31.14.131-1692982717559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 16:59:04,276 WARN [Listener at localhost/43405] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-25 16:59:04,277 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/dfs/data/data9/current/BP-1753136811-172.31.14.131-1692982717559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 16:59:04,288 INFO [Listener at localhost/43405] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 16:59:04,391 WARN [BP-1753136811-172.31.14.131-1692982717559 heartbeating to localhost/127.0.0.1:41217] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-25 16:59:04,391 WARN [BP-1753136811-172.31.14.131-1692982717559 heartbeating to localhost/127.0.0.1:41217] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1753136811-172.31.14.131-1692982717559 (Datanode Uuid afce3af0-7725-4350-80a3-3e9af16385e4) service to localhost/127.0.0.1:41217 2023-08-25 16:59:04,392 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/dfs/data/data7/current/BP-1753136811-172.31.14.131-1692982717559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 16:59:04,392 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/dfs/data/data8/current/BP-1753136811-172.31.14.131-1692982717559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 16:59:04,393 WARN [Listener at localhost/43405] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-25 16:59:04,398 INFO [Listener at localhost/43405] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 16:59:04,501 WARN [BP-1753136811-172.31.14.131-1692982717559 heartbeating to localhost/127.0.0.1:41217] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-25 16:59:04,502 WARN [BP-1753136811-172.31.14.131-1692982717559 heartbeating to localhost/127.0.0.1:41217] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1753136811-172.31.14.131-1692982717559 (Datanode Uuid 07d65345-438f-42cb-8e90-8e142fba4d7a) service to localhost/127.0.0.1:41217 2023-08-25 16:59:04,502 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/dfs/data/data5/current/BP-1753136811-172.31.14.131-1692982717559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 16:59:04,503 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/dfs/data/data6/current/BP-1753136811-172.31.14.131-1692982717559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 16:59:04,504 WARN [Listener at localhost/43405] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-25 16:59:04,506 INFO [Listener at localhost/43405] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 16:59:04,607 WARN [BP-1753136811-172.31.14.131-1692982717559 heartbeating to localhost/127.0.0.1:41217] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-25 16:59:04,607 WARN [BP-1753136811-172.31.14.131-1692982717559 heartbeating to localhost/127.0.0.1:41217] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1753136811-172.31.14.131-1692982717559 (Datanode Uuid f22af196-fcc3-449f-a58d-6a8beb850f78) service to localhost/127.0.0.1:41217 2023-08-25 16:59:04,608 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/dfs/data/data1/current/BP-1753136811-172.31.14.131-1692982717559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 16:59:04,609 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/cluster_4b685148-3619-d25d-ca35-a52d2c1c059d/dfs/data/data2/current/BP-1753136811-172.31.14.131-1692982717559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 16:59:04,640 INFO [Listener at localhost/43405] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 16:59:04,761 INFO [Listener at localhost/43405] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-25 16:59:04,812 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-25 16:59:04,827 INFO [Listener at localhost/43405] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=78 (was 10) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43405 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41217 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1635050447) connection to localhost/127.0.0.1:41217 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (1635050447) connection to localhost/127.0.0.1:41217 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1635050447) connection to localhost/127.0.0.1:41217 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@4a616886 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:41217 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=467 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=171 (was 181), ProcessCount=169 (was 169), AvailableMemoryMB=6514 (was 6566) 2023-08-25 16:59:04,841 INFO [Listener at localhost/43405] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=78, OpenFileDescriptor=467, MaxFileDescriptor=60000, SystemLoadAverage=171, ProcessCount=169, AvailableMemoryMB=6513 2023-08-25 16:59:04,841 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-25 16:59:04,842 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/hadoop.log.dir so I do NOT create it in target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555 2023-08-25 16:59:04,842 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f400720e-cd5b-e5d5-02ec-12900694f345/hadoop.tmp.dir so I do NOT create it in target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555 2023-08-25 16:59:04,842 INFO [Listener at localhost/43405] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/cluster_a709966d-59b1-072e-90ea-2d14dfe30135, deleteOnExit=true 2023-08-25 16:59:04,842 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-25 16:59:04,842 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/test.cache.data in system properties and HBase conf 2023-08-25 16:59:04,843 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/hadoop.tmp.dir in system properties and HBase conf 2023-08-25 16:59:04,843 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/hadoop.log.dir in system properties and HBase conf 2023-08-25 16:59:04,843 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-25 16:59:04,843 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-25 16:59:04,843 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-25 16:59:04,843 DEBUG [Listener at localhost/43405] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-25 16:59:04,844 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-25 16:59:04,844 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-25 16:59:04,844 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-25 16:59:04,844 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-25 16:59:04,844 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-25 16:59:04,845 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-25 16:59:04,845 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-25 16:59:04,845 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-25 16:59:04,845 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-25 16:59:04,845 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/nfs.dump.dir in system properties and HBase conf 2023-08-25 16:59:04,845 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/java.io.tmpdir in system properties and HBase conf 2023-08-25 16:59:04,845 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-25 16:59:04,845 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-25 16:59:04,846 INFO [Listener at localhost/43405] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-25 16:59:04,853 WARN [Listener at localhost/43405] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-25 16:59:04,853 WARN [Listener at localhost/43405] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-25 16:59:04,905 WARN [Listener at localhost/43405] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 16:59:04,907 INFO [Listener at localhost/43405] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 16:59:04,913 INFO [Listener at localhost/43405] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/java.io.tmpdir/Jetty_localhost_41671_hdfs____stw331/webapp 2023-08-25 16:59:05,017 INFO [Listener at localhost/43405] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41671 2023-08-25 16:59:05,024 WARN [Listener at localhost/43405] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-25 16:59:05,024 WARN [Listener at localhost/43405] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-25 16:59:05,068 WARN [Listener at localhost/40879] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 16:59:05,085 WARN [Listener at localhost/40879] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-25 16:59:05,087 WARN [Listener at localhost/40879] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 16:59:05,089 INFO [Listener at localhost/40879] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 16:59:05,095 INFO [Listener at localhost/40879] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/java.io.tmpdir/Jetty_localhost_39649_datanode____.cr4qro/webapp 2023-08-25 16:59:05,213 INFO [Listener at localhost/40879] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39649 2023-08-25 16:59:05,229 WARN [Listener at localhost/43543] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 16:59:05,250 WARN [Listener at localhost/43543] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-25 16:59:05,252 WARN [Listener at localhost/43543] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 16:59:05,254 INFO [Listener at localhost/43543] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 16:59:05,258 INFO [Listener at localhost/43543] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/java.io.tmpdir/Jetty_localhost_34381_datanode____v2lcya/webapp 2023-08-25 16:59:05,337 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcf682834585f5669: Processing first storage report for DS-3992d91b-b9ea-4486-ba22-45137f071057 from datanode ef5cf1c0-7cbf-4c85-ba1e-69cb4b77ede7 2023-08-25 16:59:05,338 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcf682834585f5669: from storage DS-3992d91b-b9ea-4486-ba22-45137f071057 node DatanodeRegistration(127.0.0.1:42141, datanodeUuid=ef5cf1c0-7cbf-4c85-ba1e-69cb4b77ede7, infoPort=39349, infoSecurePort=0, ipcPort=43543, storageInfo=lv=-57;cid=testClusterID;nsid=999422714;c=1692982744859), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:59:05,338 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcf682834585f5669: Processing first storage report for DS-f8e4fe42-df5f-4a9b-abe8-31073ca27386 from datanode ef5cf1c0-7cbf-4c85-ba1e-69cb4b77ede7 2023-08-25 16:59:05,338 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcf682834585f5669: from storage DS-f8e4fe42-df5f-4a9b-abe8-31073ca27386 node DatanodeRegistration(127.0.0.1:42141, datanodeUuid=ef5cf1c0-7cbf-4c85-ba1e-69cb4b77ede7, infoPort=39349, infoSecurePort=0, ipcPort=43543, storageInfo=lv=-57;cid=testClusterID;nsid=999422714;c=1692982744859), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:59:05,358 INFO [Listener at localhost/43543] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34381 2023-08-25 16:59:05,366 WARN [Listener at localhost/34971] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 16:59:05,465 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbdec3624dc2fa65a: Processing first storage report for DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33 from datanode 898866fc-fc87-483b-bb2a-6df7cfe471d0 2023-08-25 16:59:05,466 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbdec3624dc2fa65a: from storage DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33 node DatanodeRegistration(127.0.0.1:41733, datanodeUuid=898866fc-fc87-483b-bb2a-6df7cfe471d0, infoPort=33071, infoSecurePort=0, ipcPort=34971, storageInfo=lv=-57;cid=testClusterID;nsid=999422714;c=1692982744859), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:59:05,466 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbdec3624dc2fa65a: Processing first storage report for DS-6960325b-6fb5-43c0-a7b4-2bdfceb6ae4d from datanode 898866fc-fc87-483b-bb2a-6df7cfe471d0 2023-08-25 16:59:05,466 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbdec3624dc2fa65a: from storage DS-6960325b-6fb5-43c0-a7b4-2bdfceb6ae4d node DatanodeRegistration(127.0.0.1:41733, datanodeUuid=898866fc-fc87-483b-bb2a-6df7cfe471d0, infoPort=33071, infoSecurePort=0, ipcPort=34971, storageInfo=lv=-57;cid=testClusterID;nsid=999422714;c=1692982744859), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 16:59:05,475 DEBUG [Listener at localhost/34971] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555 2023-08-25 16:59:05,478 INFO [Listener at localhost/34971] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/cluster_a709966d-59b1-072e-90ea-2d14dfe30135/zookeeper_0, clientPort=51927, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/cluster_a709966d-59b1-072e-90ea-2d14dfe30135/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/cluster_a709966d-59b1-072e-90ea-2d14dfe30135/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-25 16:59:05,479 INFO [Listener at localhost/34971] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51927 2023-08-25 16:59:05,479 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:59:05,480 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:59:05,496 INFO [Listener at localhost/34971] util.FSUtils(471): Created version file at hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674 with version=8 2023-08-25 16:59:05,496 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/hbase-staging 2023-08-25 16:59:05,498 INFO [Listener at localhost/34971] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-25 16:59:05,498 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 16:59:05,498 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-25 16:59:05,499 INFO [Listener at localhost/34971] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-25 16:59:05,499 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 16:59:05,499 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-25 16:59:05,499 INFO [Listener at localhost/34971] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-25 16:59:05,500 INFO [Listener at localhost/34971] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44829 2023-08-25 16:59:05,500 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:59:05,502 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:59:05,503 INFO [Listener at localhost/34971] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44829 connecting to ZooKeeper ensemble=127.0.0.1:51927 2023-08-25 16:59:05,510 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:448290x0, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-25 16:59:05,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44829-0x1004461d12b0000 connected 2023-08-25 16:59:05,526 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-25 16:59:05,527 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 16:59:05,527 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-25 16:59:05,528 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44829 2023-08-25 16:59:05,528 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44829 2023-08-25 16:59:05,528 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44829 2023-08-25 16:59:05,528 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44829 2023-08-25 16:59:05,528 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44829 2023-08-25 16:59:05,529 INFO [Listener at localhost/34971] master.HMaster(444): hbase.rootdir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674, hbase.cluster.distributed=false 2023-08-25 16:59:05,542 INFO [Listener at localhost/34971] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-25 16:59:05,543 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 16:59:05,543 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-25 16:59:05,543 INFO [Listener at localhost/34971] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-25 16:59:05,543 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 16:59:05,543 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-25 16:59:05,543 INFO [Listener at localhost/34971] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-25 16:59:05,546 INFO [Listener at localhost/34971] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38623 2023-08-25 16:59:05,546 INFO [Listener at localhost/34971] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-25 16:59:05,547 DEBUG [Listener at localhost/34971] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-25 16:59:05,548 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:59:05,549 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:59:05,550 INFO [Listener at localhost/34971] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38623 connecting to ZooKeeper ensemble=127.0.0.1:51927 2023-08-25 16:59:05,554 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:386230x0, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-25 16:59:05,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38623-0x1004461d12b0001 connected 2023-08-25 16:59:05,555 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-25 16:59:05,556 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 16:59:05,556 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-25 16:59:05,559 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38623 2023-08-25 16:59:05,559 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38623 2023-08-25 16:59:05,561 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38623 2023-08-25 16:59:05,561 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38623 2023-08-25 16:59:05,561 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38623 2023-08-25 16:59:05,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44829,1692982745498 2023-08-25 16:59:05,564 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-25 16:59:05,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44829,1692982745498 2023-08-25 16:59:05,566 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-25 16:59:05,566 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:59:05,566 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-25 16:59:05,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-25 16:59:05,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44829,1692982745498 from backup master directory 2023-08-25 16:59:05,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-25 16:59:05,571 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44829,1692982745498 2023-08-25 16:59:05,571 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-25 16:59:05,571 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-25 16:59:05,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44829,1692982745498 2023-08-25 16:59:05,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/hbase.id with ID: a1834938-dcfb-4a38-b035-6909d336f4d7 2023-08-25 16:59:05,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:59:05,611 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:59:05,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5c1aebea to 127.0.0.1:51927 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-25 16:59:05,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f6e50b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-25 16:59:05,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-25 16:59:05,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-25 16:59:05,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 16:59:05,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/data/master/store-tmp 2023-08-25 16:59:05,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:59:05,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-25 16:59:05,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 16:59:05,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 16:59:05,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-25 16:59:05,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 16:59:05,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 16:59:05,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-25 16:59:05,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/WALs/jenkins-hbase4.apache.org,44829,1692982745498 2023-08-25 16:59:05,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44829%2C1692982745498, suffix=, logDir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/WALs/jenkins-hbase4.apache.org,44829,1692982745498, archiveDir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/oldWALs, maxLogs=10 2023-08-25 16:59:05,664 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41733,DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33,DISK] 2023-08-25 16:59:05,665 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42141,DS-3992d91b-b9ea-4486-ba22-45137f071057,DISK] 2023-08-25 16:59:05,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/WALs/jenkins-hbase4.apache.org,44829,1692982745498/jenkins-hbase4.apache.org%2C44829%2C1692982745498.1692982745648 2023-08-25 16:59:05,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41733,DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33,DISK], DatanodeInfoWithStorage[127.0.0.1:42141,DS-3992d91b-b9ea-4486-ba22-45137f071057,DISK]] 2023-08-25 16:59:05,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-25 16:59:05,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:59:05,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-25 16:59:05,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-25 16:59:05,672 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-25 16:59:05,674 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-25 16:59:05,674 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-25 16:59:05,675 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:59:05,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-25 16:59:05,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-25 16:59:05,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-25 16:59:05,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 16:59:05,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=694430, jitterRate=-0.1169871836900711}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 16:59:05,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-25 16:59:05,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-25 16:59:05,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-25 16:59:05,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-25 16:59:05,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-25 16:59:05,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-25 16:59:05,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-25 16:59:05,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-25 16:59:05,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-25 16:59:05,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-25 16:59:05,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-25 16:59:05,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-25 16:59:05,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-25 16:59:05,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-25 16:59:05,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-25 16:59:05,705 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:59:05,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-25 16:59:05,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-25 16:59:05,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-25 16:59:05,709 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-25 16:59:05,709 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-25 16:59:05,709 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:59:05,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44829,1692982745498, sessionid=0x1004461d12b0000, setting cluster-up flag (Was=false) 2023-08-25 16:59:05,715 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:59:05,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-25 16:59:05,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44829,1692982745498 2023-08-25 16:59:05,725 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:59:05,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-25 16:59:05,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44829,1692982745498 2023-08-25 16:59:05,733 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/.hbase-snapshot/.tmp 2023-08-25 16:59:05,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-25 16:59:05,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 16:59:05,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 16:59:05,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 16:59:05,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 16:59:05,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-25 16:59:05,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:59:05,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-25 16:59:05,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:59:05,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1692982775741 2023-08-25 16:59:05,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-25 16:59:05,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-25 16:59:05,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-25 16:59:05,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-25 16:59:05,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-25 16:59:05,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-25 16:59:05,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:05,745 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-25 16:59:05,745 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-25 16:59:05,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-25 16:59:05,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-25 16:59:05,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-25 16:59:05,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-25 16:59:05,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-25 16:59:05,747 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-25 16:59:05,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1692982745746,5,FailOnTimeoutGroup] 2023-08-25 16:59:05,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1692982745747,5,FailOnTimeoutGroup] 2023-08-25 16:59:05,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:05,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-25 16:59:05,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:05,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:05,762 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-25 16:59:05,764 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-25 16:59:05,764 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674 2023-08-25 16:59:05,764 INFO [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(951): ClusterId : a1834938-dcfb-4a38-b035-6909d336f4d7 2023-08-25 16:59:05,765 DEBUG [RS:0;jenkins-hbase4:38623] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-25 16:59:05,768 DEBUG [RS:0;jenkins-hbase4:38623] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-25 16:59:05,768 DEBUG [RS:0;jenkins-hbase4:38623] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-25 16:59:05,770 DEBUG [RS:0;jenkins-hbase4:38623] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-25 16:59:05,771 DEBUG [RS:0;jenkins-hbase4:38623] zookeeper.ReadOnlyZKClient(139): Connect 0x7e943b08 to 127.0.0.1:51927 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-25 16:59:05,776 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:59:05,777 DEBUG [RS:0;jenkins-hbase4:38623] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7053daaa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-25 16:59:05,777 DEBUG [RS:0;jenkins-hbase4:38623] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@746c5078, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-25 16:59:05,778 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-25 16:59:05,780 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/info 2023-08-25 16:59:05,781 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-25 16:59:05,782 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:59:05,782 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-25 16:59:05,785 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/rep_barrier 2023-08-25 16:59:05,786 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-25 16:59:05,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:59:05,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-25 16:59:05,788 DEBUG [RS:0;jenkins-hbase4:38623] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38623 2023-08-25 16:59:05,789 INFO [RS:0;jenkins-hbase4:38623] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-25 16:59:05,789 INFO [RS:0;jenkins-hbase4:38623] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-25 16:59:05,789 DEBUG [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(1022): About to register with Master. 2023-08-25 16:59:05,790 INFO [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44829,1692982745498 with isa=jenkins-hbase4.apache.org/172.31.14.131:38623, startcode=1692982745542 2023-08-25 16:59:05,790 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/table 2023-08-25 16:59:05,790 DEBUG [RS:0;jenkins-hbase4:38623] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-25 16:59:05,791 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-25 16:59:05,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:59:05,794 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740 2023-08-25 16:59:05,796 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47029, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-08-25 16:59:05,796 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740 2023-08-25 16:59:05,797 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44829] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:05,798 DEBUG [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674 2023-08-25 16:59:05,798 DEBUG [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40879 2023-08-25 16:59:05,798 DEBUG [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-25 16:59:05,804 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-25 16:59:05,805 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-25 16:59:05,805 DEBUG [RS:0;jenkins-hbase4:38623] zookeeper.ZKUtil(162): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:05,805 WARN [RS:0;jenkins-hbase4:38623] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-25 16:59:05,805 INFO [RS:0;jenkins-hbase4:38623] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 16:59:05,806 DEBUG [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:05,807 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-25 16:59:05,812 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38623,1692982745542] 2023-08-25 16:59:05,812 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 16:59:05,813 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=779559, jitterRate=-0.00874049961566925}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-25 16:59:05,814 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-25 16:59:05,814 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-25 16:59:05,814 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-25 16:59:05,814 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-25 16:59:05,814 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-25 16:59:05,814 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-25 16:59:05,814 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-25 16:59:05,814 DEBUG [RS:0;jenkins-hbase4:38623] zookeeper.ZKUtil(162): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:05,814 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-25 16:59:05,815 DEBUG [RS:0;jenkins-hbase4:38623] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-25 16:59:05,816 INFO [RS:0;jenkins-hbase4:38623] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-25 16:59:05,816 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-25 16:59:05,816 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-25 16:59:05,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-25 16:59:05,818 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-25 16:59:05,819 INFO [RS:0;jenkins-hbase4:38623] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-25 16:59:05,820 INFO [RS:0;jenkins-hbase4:38623] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-25 16:59:05,820 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-25 16:59:05,820 INFO [RS:0;jenkins-hbase4:38623] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:05,821 INFO [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-25 16:59:05,822 INFO [RS:0;jenkins-hbase4:38623] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:05,823 DEBUG [RS:0;jenkins-hbase4:38623] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:59:05,823 DEBUG [RS:0;jenkins-hbase4:38623] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:59:05,823 DEBUG [RS:0;jenkins-hbase4:38623] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:59:05,823 DEBUG [RS:0;jenkins-hbase4:38623] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:59:05,823 DEBUG [RS:0;jenkins-hbase4:38623] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:59:05,823 DEBUG [RS:0;jenkins-hbase4:38623] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-25 16:59:05,823 DEBUG [RS:0;jenkins-hbase4:38623] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:59:05,823 DEBUG [RS:0;jenkins-hbase4:38623] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:59:05,823 DEBUG [RS:0;jenkins-hbase4:38623] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:59:05,823 DEBUG [RS:0;jenkins-hbase4:38623] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 16:59:05,828 INFO [RS:0;jenkins-hbase4:38623] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:05,829 INFO [RS:0;jenkins-hbase4:38623] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:05,829 INFO [RS:0;jenkins-hbase4:38623] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:05,841 INFO [RS:0;jenkins-hbase4:38623] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-25 16:59:05,841 INFO [RS:0;jenkins-hbase4:38623] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38623,1692982745542-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:05,853 INFO [RS:0;jenkins-hbase4:38623] regionserver.Replication(203): jenkins-hbase4.apache.org,38623,1692982745542 started 2023-08-25 16:59:05,853 INFO [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38623,1692982745542, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38623, sessionid=0x1004461d12b0001 2023-08-25 16:59:05,853 DEBUG [RS:0;jenkins-hbase4:38623] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-25 16:59:05,853 DEBUG [RS:0;jenkins-hbase4:38623] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:05,853 DEBUG [RS:0;jenkins-hbase4:38623] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38623,1692982745542' 2023-08-25 16:59:05,853 DEBUG [RS:0;jenkins-hbase4:38623] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 16:59:05,853 DEBUG [RS:0;jenkins-hbase4:38623] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 16:59:05,854 DEBUG [RS:0;jenkins-hbase4:38623] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-25 16:59:05,854 DEBUG [RS:0;jenkins-hbase4:38623] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-25 16:59:05,854 DEBUG [RS:0;jenkins-hbase4:38623] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:05,854 DEBUG [RS:0;jenkins-hbase4:38623] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38623,1692982745542' 2023-08-25 16:59:05,854 DEBUG [RS:0;jenkins-hbase4:38623] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-25 16:59:05,854 DEBUG [RS:0;jenkins-hbase4:38623] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-25 16:59:05,855 DEBUG [RS:0;jenkins-hbase4:38623] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-25 16:59:05,855 INFO [RS:0;jenkins-hbase4:38623] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-25 16:59:05,855 INFO [RS:0;jenkins-hbase4:38623] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-25 16:59:05,958 INFO [RS:0;jenkins-hbase4:38623] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38623%2C1692982745542, suffix=, logDir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542, archiveDir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/oldWALs, maxLogs=32 2023-08-25 16:59:05,970 DEBUG [jenkins-hbase4:44829] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-25 16:59:05,971 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38623,1692982745542, state=OPENING 2023-08-25 16:59:05,973 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-25 16:59:05,975 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:59:05,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38623,1692982745542}] 2023-08-25 16:59:05,975 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-25 16:59:05,996 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42141,DS-3992d91b-b9ea-4486-ba22-45137f071057,DISK] 2023-08-25 16:59:05,996 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41733,DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33,DISK] 2023-08-25 16:59:05,999 INFO [RS:0;jenkins-hbase4:38623] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982745960 2023-08-25 16:59:05,999 DEBUG [RS:0;jenkins-hbase4:38623] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42141,DS-3992d91b-b9ea-4486-ba22-45137f071057,DISK], DatanodeInfoWithStorage[127.0.0.1:41733,DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33,DISK]] 2023-08-25 16:59:06,148 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:06,148 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-25 16:59:06,150 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-25 16:59:06,155 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-25 16:59:06,155 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 16:59:06,157 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38623%2C1692982745542.meta, suffix=.meta, logDir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542, archiveDir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/oldWALs, maxLogs=32 2023-08-25 16:59:06,174 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41733,DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33,DISK] 2023-08-25 16:59:06,174 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42141,DS-3992d91b-b9ea-4486-ba22-45137f071057,DISK] 2023-08-25 16:59:06,177 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.meta.1692982746158.meta 2023-08-25 16:59:06,177 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41733,DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33,DISK], DatanodeInfoWithStorage[127.0.0.1:42141,DS-3992d91b-b9ea-4486-ba22-45137f071057,DISK]] 2023-08-25 16:59:06,177 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-25 16:59:06,178 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-25 16:59:06,178 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-25 16:59:06,179 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-25 16:59:06,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-25 16:59:06,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:59:06,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-25 16:59:06,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-25 16:59:06,180 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-25 16:59:06,182 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/info 2023-08-25 16:59:06,182 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/info 2023-08-25 16:59:06,182 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-25 16:59:06,183 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:59:06,183 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-25 16:59:06,184 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/rep_barrier 2023-08-25 16:59:06,184 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/rep_barrier 2023-08-25 16:59:06,184 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-25 16:59:06,185 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:59:06,185 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-25 16:59:06,186 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/table 2023-08-25 16:59:06,186 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/table 2023-08-25 16:59:06,187 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-25 16:59:06,188 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:59:06,189 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740 2023-08-25 16:59:06,190 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740 2023-08-25 16:59:06,193 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-25 16:59:06,194 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-25 16:59:06,195 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=800551, jitterRate=0.017953485250473022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-25 16:59:06,195 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-25 16:59:06,196 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1692982746148 2023-08-25 16:59:06,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-25 16:59:06,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-25 16:59:06,201 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38623,1692982745542, state=OPEN 2023-08-25 16:59:06,204 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-25 16:59:06,204 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-25 16:59:06,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-25 16:59:06,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38623,1692982745542 in 229 msec 2023-08-25 16:59:06,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-25 16:59:06,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 390 msec 2023-08-25 16:59:06,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 472 msec 2023-08-25 16:59:06,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1692982746211, completionTime=-1 2023-08-25 16:59:06,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-25 16:59:06,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-25 16:59:06,215 DEBUG [hconnection-0x9151411-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-25 16:59:06,216 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-25 16:59:06,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-25 16:59:06,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1692982806218 2023-08-25 16:59:06,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1692982866218 2023-08-25 16:59:06,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 6 msec 2023-08-25 16:59:06,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44829,1692982745498-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:06,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44829,1692982745498-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:06,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44829,1692982745498-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:06,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44829, period=300000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:06,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:06,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-25 16:59:06,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-25 16:59:06,226 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-25 16:59:06,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-25 16:59:06,228 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-25 16:59:06,229 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-25 16:59:06,230 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/.tmp/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38 2023-08-25 16:59:06,231 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/.tmp/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38 empty. 2023-08-25 16:59:06,231 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/.tmp/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38 2023-08-25 16:59:06,232 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-25 16:59:06,247 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-25 16:59:06,248 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => fa1ff8433194ff0e12b460a5e9e26b38, NAME => 'hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/.tmp 2023-08-25 16:59:06,259 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:59:06,259 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing fa1ff8433194ff0e12b460a5e9e26b38, disabling compactions & flushes 2023-08-25 16:59:06,259 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 16:59:06,260 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 16:59:06,260 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. after waiting 0 ms 2023-08-25 16:59:06,260 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 16:59:06,260 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 16:59:06,260 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for fa1ff8433194ff0e12b460a5e9e26b38: 2023-08-25 16:59:06,263 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-25 16:59:06,265 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692982746264"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692982746264"}]},"ts":"1692982746264"} 2023-08-25 16:59:06,267 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-25 16:59:06,269 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-25 16:59:06,269 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982746269"}]},"ts":"1692982746269"} 2023-08-25 16:59:06,271 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-25 16:59:06,279 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fa1ff8433194ff0e12b460a5e9e26b38, ASSIGN}] 2023-08-25 16:59:06,282 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fa1ff8433194ff0e12b460a5e9e26b38, ASSIGN 2023-08-25 16:59:06,283 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=fa1ff8433194ff0e12b460a5e9e26b38, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38623,1692982745542; forceNewPlan=false, retain=false 2023-08-25 16:59:06,433 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fa1ff8433194ff0e12b460a5e9e26b38, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:06,434 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692982746433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1692982746433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692982746433"}]},"ts":"1692982746433"} 2023-08-25 16:59:06,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure fa1ff8433194ff0e12b460a5e9e26b38, server=jenkins-hbase4.apache.org,38623,1692982745542}] 2023-08-25 16:59:06,473 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-25 16:59:06,593 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 16:59:06,593 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa1ff8433194ff0e12b460a5e9e26b38, NAME => 'hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38.', STARTKEY => '', ENDKEY => ''} 2023-08-25 16:59:06,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace fa1ff8433194ff0e12b460a5e9e26b38 2023-08-25 16:59:06,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:59:06,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fa1ff8433194ff0e12b460a5e9e26b38 2023-08-25 16:59:06,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fa1ff8433194ff0e12b460a5e9e26b38 2023-08-25 16:59:06,596 INFO [StoreOpener-fa1ff8433194ff0e12b460a5e9e26b38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fa1ff8433194ff0e12b460a5e9e26b38 2023-08-25 16:59:06,598 DEBUG [StoreOpener-fa1ff8433194ff0e12b460a5e9e26b38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38/info 2023-08-25 16:59:06,598 DEBUG [StoreOpener-fa1ff8433194ff0e12b460a5e9e26b38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38/info 2023-08-25 16:59:06,598 INFO [StoreOpener-fa1ff8433194ff0e12b460a5e9e26b38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa1ff8433194ff0e12b460a5e9e26b38 columnFamilyName info 2023-08-25 16:59:06,599 INFO [StoreOpener-fa1ff8433194ff0e12b460a5e9e26b38-1] regionserver.HStore(310): Store=fa1ff8433194ff0e12b460a5e9e26b38/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:59:06,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38 2023-08-25 16:59:06,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38 2023-08-25 16:59:06,604 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fa1ff8433194ff0e12b460a5e9e26b38 2023-08-25 16:59:06,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 16:59:06,607 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fa1ff8433194ff0e12b460a5e9e26b38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=723266, jitterRate=-0.08032059669494629}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 16:59:06,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fa1ff8433194ff0e12b460a5e9e26b38: 2023-08-25 16:59:06,608 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38., pid=6, masterSystemTime=1692982746589 2023-08-25 16:59:06,611 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 16:59:06,611 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 16:59:06,612 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fa1ff8433194ff0e12b460a5e9e26b38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:06,613 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692982746612"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1692982746612"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692982746612"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692982746612"}]},"ts":"1692982746612"} 2023-08-25 16:59:06,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-25 16:59:06,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure fa1ff8433194ff0e12b460a5e9e26b38, server=jenkins-hbase4.apache.org,38623,1692982745542 in 179 msec 2023-08-25 16:59:06,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-25 16:59:06,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=fa1ff8433194ff0e12b460a5e9e26b38, ASSIGN in 339 msec 2023-08-25 16:59:06,622 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-25 16:59:06,622 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982746622"}]},"ts":"1692982746622"} 2023-08-25 16:59:06,624 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-25 16:59:06,627 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-25 16:59:06,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-25 16:59:06,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 402 msec 2023-08-25 16:59:06,630 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-25 16:59:06,630 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:59:06,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-25 16:59:06,642 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-25 16:59:06,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-08-25 16:59:06,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-25 16:59:06,665 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-25 16:59:06,670 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-08-25 16:59:06,682 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-25 16:59:06,689 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-25 16:59:06,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.118sec 2023-08-25 16:59:06,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-25 16:59:06,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-25 16:59:06,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-25 16:59:06,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44829,1692982745498-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-25 16:59:06,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44829,1692982745498-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-25 16:59:06,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-25 16:59:06,764 DEBUG [Listener at localhost/34971] zookeeper.ReadOnlyZKClient(139): Connect 0x2410ef0c to 127.0.0.1:51927 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-25 16:59:06,769 DEBUG [Listener at localhost/34971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4da0e38d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-25 16:59:06,770 DEBUG [hconnection-0xa9e1fcb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-25 16:59:06,772 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-25 16:59:06,775 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44829,1692982745498 2023-08-25 16:59:06,775 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 16:59:06,780 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-25 16:59:06,780 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 16:59:06,781 INFO [Listener at localhost/34971] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-25 16:59:06,783 DEBUG [Listener at localhost/34971] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-25 16:59:06,787 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-25 16:59:06,789 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-25 16:59:06,789 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-25 16:59:06,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-25 16:59:06,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:06,792 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-08-25 16:59:06,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testCompactionRecordDoesntBlockRolling" procId is: 9 2023-08-25 16:59:06,793 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-25 16:59:06,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-25 16:59:06,795 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9 2023-08-25 16:59:06,796 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9 empty. 2023-08-25 16:59:06,796 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9 2023-08-25 16:59:06,797 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testCompactionRecordDoesntBlockRolling regions 2023-08-25 16:59:06,813 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/.tabledesc/.tableinfo.0000000001 2023-08-25 16:59:06,815 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7a2ed80ea85cdb555e5aa3f84b0ea5b9, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/.tmp 2023-08-25 16:59:06,827 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:59:06,827 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1604): Closing 7a2ed80ea85cdb555e5aa3f84b0ea5b9, disabling compactions & flushes 2023-08-25 16:59:06,827 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:06,827 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:06,827 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. after waiting 0 ms 2023-08-25 16:59:06,827 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:06,827 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:06,827 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1558): Region close journal for 7a2ed80ea85cdb555e5aa3f84b0ea5b9: 2023-08-25 16:59:06,830 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ADD_TO_META 2023-08-25 16:59:06,832 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1692982746832"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692982746832"}]},"ts":"1692982746832"} 2023-08-25 16:59:06,834 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-25 16:59:06,836 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-25 16:59:06,836 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982746836"}]},"ts":"1692982746836"} 2023-08-25 16:59:06,838 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLING in hbase:meta 2023-08-25 16:59:06,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=7a2ed80ea85cdb555e5aa3f84b0ea5b9, ASSIGN}] 2023-08-25 16:59:06,851 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=7a2ed80ea85cdb555e5aa3f84b0ea5b9, ASSIGN 2023-08-25 16:59:06,854 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=7a2ed80ea85cdb555e5aa3f84b0ea5b9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38623,1692982745542; forceNewPlan=false, retain=false 2023-08-25 16:59:07,005 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7a2ed80ea85cdb555e5aa3f84b0ea5b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:07,006 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1692982747005"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1692982747005"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692982747005"}]},"ts":"1692982747005"} 2023-08-25 16:59:07,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 7a2ed80ea85cdb555e5aa3f84b0ea5b9, server=jenkins-hbase4.apache.org,38623,1692982745542}] 2023-08-25 16:59:07,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:07,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a2ed80ea85cdb555e5aa3f84b0ea5b9, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9.', STARTKEY => '', ENDKEY => ''} 2023-08-25 16:59:07,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testCompactionRecordDoesntBlockRolling 7a2ed80ea85cdb555e5aa3f84b0ea5b9 2023-08-25 16:59:07,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 16:59:07,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7a2ed80ea85cdb555e5aa3f84b0ea5b9 2023-08-25 16:59:07,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7a2ed80ea85cdb555e5aa3f84b0ea5b9 2023-08-25 16:59:07,169 INFO [StoreOpener-7a2ed80ea85cdb555e5aa3f84b0ea5b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7a2ed80ea85cdb555e5aa3f84b0ea5b9 2023-08-25 16:59:07,171 DEBUG [StoreOpener-7a2ed80ea85cdb555e5aa3f84b0ea5b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info 2023-08-25 16:59:07,171 DEBUG [StoreOpener-7a2ed80ea85cdb555e5aa3f84b0ea5b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info 2023-08-25 16:59:07,171 INFO [StoreOpener-7a2ed80ea85cdb555e5aa3f84b0ea5b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a2ed80ea85cdb555e5aa3f84b0ea5b9 columnFamilyName info 2023-08-25 16:59:07,172 INFO [StoreOpener-7a2ed80ea85cdb555e5aa3f84b0ea5b9-1] regionserver.HStore(310): Store=7a2ed80ea85cdb555e5aa3f84b0ea5b9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 16:59:07,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9 2023-08-25 16:59:07,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9 2023-08-25 16:59:07,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7a2ed80ea85cdb555e5aa3f84b0ea5b9 2023-08-25 16:59:07,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 16:59:07,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7a2ed80ea85cdb555e5aa3f84b0ea5b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=794293, jitterRate=0.00999586284160614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 16:59:07,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7a2ed80ea85cdb555e5aa3f84b0ea5b9: 2023-08-25 16:59:07,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9., pid=11, masterSystemTime=1692982747162 2023-08-25 16:59:07,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:07,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:07,184 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7a2ed80ea85cdb555e5aa3f84b0ea5b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:07,184 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1692982747184"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1692982747184"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692982747184"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692982747184"}]},"ts":"1692982747184"} 2023-08-25 16:59:07,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-25 16:59:07,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 7a2ed80ea85cdb555e5aa3f84b0ea5b9, server=jenkins-hbase4.apache.org,38623,1692982745542 in 177 msec 2023-08-25 16:59:07,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-25 16:59:07,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=7a2ed80ea85cdb555e5aa3f84b0ea5b9, ASSIGN in 340 msec 2023-08-25 16:59:07,193 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-25 16:59:07,193 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982747193"}]},"ts":"1692982747193"} 2023-08-25 16:59:07,194 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLED in hbase:meta 2023-08-25 16:59:07,197 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_POST_OPERATION 2023-08-25 16:59:07,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling in 408 msec 2023-08-25 16:59:10,967 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-25 16:59:10,967 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-08-25 16:59:11,683 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-25 16:59:11,816 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-25 16:59:11,817 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-25 16:59:11,817 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-25 16:59:16,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-25 16:59:16,796 INFO [Listener at localhost/34971] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testCompactionRecordDoesntBlockRolling, procId: 9 completed 2023-08-25 16:59:16,798 DEBUG [Listener at localhost/34971] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:16,799 DEBUG [Listener at localhost/34971] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:16,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-25 16:59:16,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] procedure.ProcedureCoordinator(165): Submitting procedure hbase:namespace 2023-08-25 16:59:16,819 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase:namespace' 2023-08-25 16:59:16,819 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-25 16:59:16,819 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase:namespace' starting 'acquire' 2023-08-25 16:59:16,819 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase:namespace', kicking off acquire phase on members. 2023-08-25 16:59:16,820 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-08-25 16:59:16,820 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-25 16:59:16,822 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-25 16:59:16,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-25 16:59:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 16:59:16,822 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,823 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,823 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-25 16:59:16,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase:namespace 2023-08-25 16:59:16,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-08-25 16:59:16,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-25 16:59:16,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-25 16:59:16,826 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase:namespace 2023-08-25 16:59:16,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase:namespace 2023-08-25 16:59:16,828 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase:namespace' with timeout 60000ms 2023-08-25 16:59:16,828 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-25 16:59:16,829 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase:namespace' starting 'acquire' stage 2023-08-25 16:59:16,830 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-25 16:59:16,830 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 16:59:16,830 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-25 16:59:16,830 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. started... 2023-08-25 16:59:16,830 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa1ff8433194ff0e12b460a5e9e26b38 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-25 16:59:16,847 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38/.tmp/info/5f2cd626f8404652b30dc1c9370416b1 2023-08-25 16:59:16,857 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38/.tmp/info/5f2cd626f8404652b30dc1c9370416b1 as hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38/info/5f2cd626f8404652b30dc1c9370416b1 2023-08-25 16:59:16,864 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38/info/5f2cd626f8404652b30dc1c9370416b1, entries=2, sequenceid=6, filesize=4.8 K 2023-08-25 16:59:16,865 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fa1ff8433194ff0e12b460a5e9e26b38 in 35ms, sequenceid=6, compaction requested=false 2023-08-25 16:59:16,866 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa1ff8433194ff0e12b460a5e9e26b38: 2023-08-25 16:59:16,866 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 16:59:16,866 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-25 16:59:16,866 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-25 16:59:16,866 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,866 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase:namespace' locally acquired 2023-08-25 16:59:16,866 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38623,1692982745542' joining acquired barrier for procedure (hbase:namespace) in zk 2023-08-25 16:59:16,869 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-25 16:59:16,869 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:16,869 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace 2023-08-25 16:59:16,869 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase:namespace' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-25 16:59:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:16,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:16,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-25 16:59:16,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:16,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38623,1692982745542' joining acquired barrier for procedure 'hbase:namespace' on coordinator 2023-08-25 16:59:16,871 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase:namespace' starting 'in-barrier' execution. 2023-08-25 16:59:16,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bb18e91[Count = 0] remaining members to acquire global barrier 2023-08-25 16:59:16,871 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-25 16:59:16,874 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-25 16:59:16,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-25 16:59:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-25 16:59:16,874 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase:namespace' received 'reached' from coordinator. 2023-08-25 16:59:16,875 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase:namespace' locally completed 2023-08-25 16:59:16,875 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,875 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase:namespace' completed for member 'jenkins-hbase4.apache.org,38623,1692982745542' in zk 2023-08-25 16:59:16,875 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-25 16:59:16,876 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase:namespace' has notified controller of completion 2023-08-25 16:59:16,876 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,876 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-25 16:59:16,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:16,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:16,876 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase:namespace' completed. 2023-08-25 16:59:16,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:16,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:16,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-25 16:59:16,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:16,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-25 16:59:16,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase:namespace' member 'jenkins-hbase4.apache.org,38623,1692982745542': 2023-08-25 16:59:16,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38623,1692982745542' released barrier for procedure'hbase:namespace', counting down latch. Waiting for 0 more 2023-08-25 16:59:16,880 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase:namespace' execution completed 2023-08-25 16:59:16,880 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-25 16:59:16,880 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-25 16:59:16,880 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase:namespace 2023-08-25 16:59:16,880 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase:namespaceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-25 16:59:16,882 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-25 16:59:16,882 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-25 16:59:16,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase:namespace 2023-08-25 16:59:16,882 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-25 16:59:16,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-08-25 16:59:16,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase:namespace 2023-08-25 16:59:16,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:16,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:16,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-25 16:59:16,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 16:59:16,883 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:16,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-08-25 16:59:16,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-25 16:59:16,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:16,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-25 16:59:16,885 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:16,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-25 16:59:16,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,891 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,891 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-25 16:59:16,891 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-25 16:59:16,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-25 16:59:16,891 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-25 16:59:16,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 16:59:16,891 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-25 16:59:16,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase:namespace' 2023-08-25 16:59:16,891 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:16,891 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-25 16:59:16,891 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-25 16:59:16,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-25 16:59:16,891 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-25 16:59:16,892 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-25 16:59:16,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-25 16:59:16,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 16:59:16,894 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase:namespace'' to complete. (max 20000 ms per retry) 2023-08-25 16:59:16,894 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-25 16:59:26,894 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-25 16:59:26,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-25 16:59:26,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-25 16:59:26,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,913 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-25 16:59:26,913 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-25 16:59:26,913 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-25 16:59:26,913 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-25 16:59:26,914 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,914 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,915 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-25 16:59:26,915 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-25 16:59:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 16:59:26,916 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,916 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-25 16:59:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-25 16:59:26,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,917 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,917 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,917 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-25 16:59:26,917 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-25 16:59:26,917 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-25 16:59:26,918 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-25 16:59:26,918 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-25 16:59:26,918 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:26,918 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. started... 2023-08-25 16:59:26,918 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a2ed80ea85cdb555e5aa3f84b0ea5b9 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-25 16:59:26,938 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/.tmp/info/df191716eb2d4f7b999da68b4e827262 2023-08-25 16:59:26,947 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/.tmp/info/df191716eb2d4f7b999da68b4e827262 as hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/df191716eb2d4f7b999da68b4e827262 2023-08-25 16:59:26,953 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/df191716eb2d4f7b999da68b4e827262, entries=1, sequenceid=5, filesize=5.8 K 2023-08-25 16:59:26,955 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 7a2ed80ea85cdb555e5aa3f84b0ea5b9 in 37ms, sequenceid=5, compaction requested=false 2023-08-25 16:59:26,955 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a2ed80ea85cdb555e5aa3f84b0ea5b9: 2023-08-25 16:59:26,955 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:26,955 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-25 16:59:26,956 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-25 16:59:26,956 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,956 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-25 16:59:26,956 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38623,1692982745542' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-25 16:59:26,958 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,958 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:26,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:26,958 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,958 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-25 16:59:26,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:26,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:26,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:26,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38623,1692982745542' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-25 16:59:26,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f8e0b3f[Count = 0] remaining members to acquire global barrier 2023-08-25 16:59:26,960 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-25 16:59:26,960 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,963 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,963 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-25 16:59:26,963 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-25 16:59:26,963 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,38623,1692982745542' in zk 2023-08-25 16:59:26,964 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,964 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-25 16:59:26,965 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,965 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-25 16:59:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:26,965 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-25 16:59:26,965 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-25 16:59:26,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:26,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:26,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:26,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,38623,1692982745542': 2023-08-25 16:59:26,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38623,1692982745542' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-25 16:59:26,968 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-25 16:59:26,969 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-25 16:59:26,969 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-25 16:59:26,969 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,969 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-25 16:59:26,978 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,978 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,978 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-25 16:59:26,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:26,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:26,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:26,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-25 16:59:26,979 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 16:59:26,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:26,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,981 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:26,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,984 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,984 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-25 16:59:26,984 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-25 16:59:26,984 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,984 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-25 16:59:26,984 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:26,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-25 16:59:26,984 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-25 16:59:26,984 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,984 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-25 16:59:26,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 16:59:26,984 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:26,985 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-25 16:59:26,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-25 16:59:26,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 16:59:26,985 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-25 16:59:36,985 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-25 16:59:36,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-25 16:59:36,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-25 16:59:36,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-25 16:59:36,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:36,997 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-25 16:59:36,998 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-25 16:59:36,998 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-25 16:59:36,998 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-25 16:59:36,999 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:36,999 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,000 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,000 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-25 16:59:37,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-25 16:59:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 16:59:37,001 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,001 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-25 16:59:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,001 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-25 16:59:37,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,002 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,002 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-25 16:59:37,002 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,002 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-25 16:59:37,002 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-25 16:59:37,003 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-25 16:59:37,003 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-25 16:59:37,003 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:37,003 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-25 16:59:37,003 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. started... 2023-08-25 16:59:37,004 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a2ed80ea85cdb555e5aa3f84b0ea5b9 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-25 16:59:37,021 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/.tmp/info/7b637c80925e416d9b0946ff92befa91 2023-08-25 16:59:37,029 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/.tmp/info/7b637c80925e416d9b0946ff92befa91 as hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/7b637c80925e416d9b0946ff92befa91 2023-08-25 16:59:37,037 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/7b637c80925e416d9b0946ff92befa91, entries=1, sequenceid=9, filesize=5.8 K 2023-08-25 16:59:37,039 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 7a2ed80ea85cdb555e5aa3f84b0ea5b9 in 36ms, sequenceid=9, compaction requested=false 2023-08-25 16:59:37,039 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a2ed80ea85cdb555e5aa3f84b0ea5b9: 2023-08-25 16:59:37,039 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:37,039 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-25 16:59:37,039 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-25 16:59:37,039 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,040 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-25 16:59:37,040 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38623,1692982745542' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-25 16:59:37,041 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,041 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:37,041 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,042 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-25 16:59:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:37,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38623,1692982745542' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-25 16:59:37,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a8c84aa[Count = 0] remaining members to acquire global barrier 2023-08-25 16:59:37,045 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-25 16:59:37,045 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,047 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,047 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-25 16:59:37,047 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-25 16:59:37,047 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,38623,1692982745542' in zk 2023-08-25 16:59:37,048 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,048 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-25 16:59:37,049 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-25 16:59:37,049 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,049 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-25 16:59:37,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:37,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:37,049 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-25 16:59:37,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:37,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,38623,1692982745542': 2023-08-25 16:59:37,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38623,1692982745542' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-25 16:59:37,053 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-25 16:59:37,053 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-25 16:59:37,053 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-25 16:59:37,053 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,053 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-25 16:59:37,055 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,055 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:37,055 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-25 16:59:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,056 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:37,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-25 16:59:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 16:59:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:37,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,057 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:37,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,060 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,060 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,060 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-25 16:59:37,060 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,060 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-25 16:59:37,060 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:37,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-25 16:59:37,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-25 16:59:37,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-25 16:59:37,060 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-25 16:59:37,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 16:59:37,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-25 16:59:37,061 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,061 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,061 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:37,061 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-25 16:59:37,062 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-25 16:59:37,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-25 16:59:37,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 16:59:47,062 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-25 16:59:47,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-25 16:59:47,083 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42141,DS-3992d91b-b9ea-4486-ba22-45137f071057,DISK] 2023-08-25 16:59:47,085 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41733,DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33,DISK] 2023-08-25 16:59:47,089 INFO [Listener at localhost/34971] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982745960 with entries=13, filesize=6.36 KB; new WAL /user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982787066 2023-08-25 16:59:47,089 DEBUG [Listener at localhost/34971] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42141,DS-3992d91b-b9ea-4486-ba22-45137f071057,DISK], DatanodeInfoWithStorage[127.0.0.1:41733,DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33,DISK]] 2023-08-25 16:59:47,089 DEBUG [Listener at localhost/34971] wal.AbstractFSWAL(716): hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982745960 is not closed yet, will try archiving it next time 2023-08-25 16:59:47,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-25 16:59:47,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-25 16:59:47,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,098 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-25 16:59:47,098 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-25 16:59:47,098 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-25 16:59:47,098 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-25 16:59:47,099 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,099 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,100 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-25 16:59:47,100 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-25 16:59:47,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 16:59:47,101 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,101 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-25 16:59:47,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-25 16:59:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,102 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,102 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-25 16:59:47,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-25 16:59:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-25 16:59:47,103 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-25 16:59:47,103 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-25 16:59:47,103 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-25 16:59:47,103 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:47,103 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. started... 2023-08-25 16:59:47,103 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a2ed80ea85cdb555e5aa3f84b0ea5b9 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-25 16:59:47,119 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=13 (bloomFilter=true), to=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/.tmp/info/4c01981b84c34c98984cb728c6b340fd 2023-08-25 16:59:47,129 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/.tmp/info/4c01981b84c34c98984cb728c6b340fd as hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/4c01981b84c34c98984cb728c6b340fd 2023-08-25 16:59:47,139 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/4c01981b84c34c98984cb728c6b340fd, entries=1, sequenceid=13, filesize=5.8 K 2023-08-25 16:59:47,140 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 7a2ed80ea85cdb555e5aa3f84b0ea5b9 in 37ms, sequenceid=13, compaction requested=true 2023-08-25 16:59:47,140 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a2ed80ea85cdb555e5aa3f84b0ea5b9: 2023-08-25 16:59:47,140 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:47,140 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-25 16:59:47,140 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-25 16:59:47,140 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,140 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-25 16:59:47,140 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38623,1692982745542' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-25 16:59:47,143 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,143 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:47,143 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,143 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-25 16:59:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:47,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38623,1692982745542' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-25 16:59:47,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ccee1ac[Count = 0] remaining members to acquire global barrier 2023-08-25 16:59:47,145 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-25 16:59:47,145 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,146 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,146 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-25 16:59:47,146 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-25 16:59:47,146 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,38623,1692982745542' in zk 2023-08-25 16:59:47,146 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,146 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-25 16:59:47,148 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-25 16:59:47,148 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,148 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-25 16:59:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:47,148 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-25 16:59:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:47,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,38623,1692982745542': 2023-08-25 16:59:47,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38623,1692982745542' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-25 16:59:47,150 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-25 16:59:47,151 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-25 16:59:47,151 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-25 16:59:47,151 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,151 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-25 16:59:47,152 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,152 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,152 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-25 16:59:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:47,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:47,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-25 16:59:47,153 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 16:59:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,154 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,158 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,158 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-25 16:59:47,158 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-25 16:59:47,158 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-25 16:59:47,158 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-25 16:59:47,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-25 16:59:47,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-25 16:59:47,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 16:59:47,158 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,159 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:47,159 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,159 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,159 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:47,159 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-25 16:59:47,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-25 16:59:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 16:59:47,159 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-25 16:59:57,159 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-25 16:59:57,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-25 16:59:57,161 DEBUG [Listener at localhost/34971] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-25 16:59:57,167 DEBUG [Listener at localhost/34971] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 17694 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-25 16:59:57,168 DEBUG [Listener at localhost/34971] regionserver.HStore(1912): 7a2ed80ea85cdb555e5aa3f84b0ea5b9/info is initiating minor compaction (all files) 2023-08-25 16:59:57,169 INFO [Listener at localhost/34971] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-25 16:59:57,169 INFO [Listener at localhost/34971] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 16:59:57,169 INFO [Listener at localhost/34971] regionserver.HRegion(2259): Starting compaction of 7a2ed80ea85cdb555e5aa3f84b0ea5b9/info in TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:57,169 INFO [Listener at localhost/34971] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/df191716eb2d4f7b999da68b4e827262, hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/7b637c80925e416d9b0946ff92befa91, hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/4c01981b84c34c98984cb728c6b340fd] into tmpdir=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/.tmp, totalSize=17.3 K 2023-08-25 16:59:57,170 DEBUG [Listener at localhost/34971] compactions.Compactor(207): Compacting df191716eb2d4f7b999da68b4e827262, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1692982766905 2023-08-25 16:59:57,171 DEBUG [Listener at localhost/34971] compactions.Compactor(207): Compacting 7b637c80925e416d9b0946ff92befa91, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1692982776988 2023-08-25 16:59:57,171 DEBUG [Listener at localhost/34971] compactions.Compactor(207): Compacting 4c01981b84c34c98984cb728c6b340fd, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1692982787065 2023-08-25 16:59:57,192 INFO [Listener at localhost/34971] throttle.PressureAwareThroughputController(145): 7a2ed80ea85cdb555e5aa3f84b0ea5b9#info#compaction#9 average throughput is unlimited, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-25 16:59:57,209 DEBUG [Listener at localhost/34971] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/.tmp/info/24f07a66d4ff4b6d9d410f636fce7955 as hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/24f07a66d4ff4b6d9d410f636fce7955 2023-08-25 16:59:57,222 INFO [Listener at localhost/34971] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7a2ed80ea85cdb555e5aa3f84b0ea5b9/info of 7a2ed80ea85cdb555e5aa3f84b0ea5b9 into 24f07a66d4ff4b6d9d410f636fce7955(size=7.9 K), total size for store is 7.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-25 16:59:57,222 DEBUG [Listener at localhost/34971] regionserver.HRegion(2289): Compaction status journal for 7a2ed80ea85cdb555e5aa3f84b0ea5b9: 2023-08-25 16:59:57,238 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42141,DS-3992d91b-b9ea-4486-ba22-45137f071057,DISK] 2023-08-25 16:59:57,238 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41733,DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33,DISK] 2023-08-25 16:59:57,240 INFO [Listener at localhost/34971] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982787066 with entries=4, filesize=2.43 KB; new WAL /user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982797224 2023-08-25 16:59:57,240 DEBUG [Listener at localhost/34971] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42141,DS-3992d91b-b9ea-4486-ba22-45137f071057,DISK], DatanodeInfoWithStorage[127.0.0.1:41733,DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33,DISK]] 2023-08-25 16:59:57,240 DEBUG [Listener at localhost/34971] wal.AbstractFSWAL(716): hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982787066 is not closed yet, will try archiving it next time 2023-08-25 16:59:57,241 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982745960 to hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/oldWALs/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982745960 2023-08-25 16:59:57,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-25 16:59:57,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-25 16:59:57,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,252 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-25 16:59:57,252 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-25 16:59:57,252 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-25 16:59:57,252 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-25 16:59:57,253 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,253 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,257 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,257 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-25 16:59:57,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-25 16:59:57,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 16:59:57,258 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,258 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-25 16:59:57,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-25 16:59:57,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,258 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,259 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-25 16:59:57,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,259 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-25 16:59:57,259 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-25 16:59:57,259 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-25 16:59:57,259 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-25 16:59:57,259 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-25 16:59:57,259 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:57,259 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. started... 2023-08-25 16:59:57,260 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a2ed80ea85cdb555e5aa3f84b0ea5b9 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-25 16:59:57,279 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=18 (bloomFilter=true), to=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/.tmp/info/b6abc47e92414759a2b70d7b933c2b69 2023-08-25 16:59:57,287 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/.tmp/info/b6abc47e92414759a2b70d7b933c2b69 as hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/b6abc47e92414759a2b70d7b933c2b69 2023-08-25 16:59:57,294 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/b6abc47e92414759a2b70d7b933c2b69, entries=1, sequenceid=18, filesize=5.8 K 2023-08-25 16:59:57,295 INFO [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 7a2ed80ea85cdb555e5aa3f84b0ea5b9 in 36ms, sequenceid=18, compaction requested=false 2023-08-25 16:59:57,295 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a2ed80ea85cdb555e5aa3f84b0ea5b9: 2023-08-25 16:59:57,295 DEBUG [rs(jenkins-hbase4.apache.org,38623,1692982745542)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 16:59:57,295 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-25 16:59:57,296 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-25 16:59:57,296 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,296 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-25 16:59:57,296 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38623,1692982745542' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-25 16:59:57,297 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,297 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:57,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:57,298 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,298 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-25 16:59:57,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:57,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:57,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:57,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38623,1692982745542' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-25 16:59:57,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b8c2da2[Count = 0] remaining members to acquire global barrier 2023-08-25 16:59:57,300 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-25 16:59:57,300 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,307 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,307 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-25 16:59:57,307 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-25 16:59:57,307 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,307 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-25 16:59:57,307 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,38623,1692982745542' in zk 2023-08-25 16:59:57,309 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-25 16:59:57,309 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,309 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-25 16:59:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,309 DEBUG [member: 'jenkins-hbase4.apache.org,38623,1692982745542' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-25 16:59:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,38623,1692982745542': 2023-08-25 16:59:57,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38623,1692982745542' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-25 16:59:57,312 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-25 16:59:57,312 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-25 16:59:57,312 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-25 16:59:57,312 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,312 INFO [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-25 16:59:57,314 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,314 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,314 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-25 16:59:57,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-25 16:59:57,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-25 16:59:57,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-25 16:59:57,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 16:59:57,314 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-25 16:59:57,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-25 16:59:57,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,316 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-25 16:59:57,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,319 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,319 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-25 16:59:57,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-25 16:59:57,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 16:59:57,319 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-25 16:59:57,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-25 16:59:57,319 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-25 16:59:57,319 DEBUG [(jenkins-hbase4.apache.org,44829,1692982745498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-25 16:59:57,319 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,319 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 16:59:57,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-25 16:59:57,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 16:59:57,320 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-25 16:59:57,319 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,320 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-25 16:59:57,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-25 16:59:57,320 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 16:59:57,320 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-25 17:00:07,320 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-25 17:00:07,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-25 17:00:07,339 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42141,DS-3992d91b-b9ea-4486-ba22-45137f071057,DISK] 2023-08-25 17:00:07,340 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41733,DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33,DISK] 2023-08-25 17:00:07,345 INFO [Listener at localhost/34971] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982797224 with entries=3, filesize=1.94 KB; new WAL /user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982807324 2023-08-25 17:00:07,345 DEBUG [Listener at localhost/34971] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42141,DS-3992d91b-b9ea-4486-ba22-45137f071057,DISK], DatanodeInfoWithStorage[127.0.0.1:41733,DS-0e2b4056-dafb-44ec-b24a-eefbc9aced33,DISK]] 2023-08-25 17:00:07,345 DEBUG [Listener at localhost/34971] wal.AbstractFSWAL(716): hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982797224 is not closed yet, will try archiving it next time 2023-08-25 17:00:07,345 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-25 17:00:07,345 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/WALs/jenkins-hbase4.apache.org,38623,1692982745542/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982787066 to hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/oldWALs/jenkins-hbase4.apache.org%2C38623%2C1692982745542.1692982787066 2023-08-25 17:00:07,345 INFO [Listener at localhost/34971] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-25 17:00:07,345 DEBUG [Listener at localhost/34971] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2410ef0c to 127.0.0.1:51927 2023-08-25 17:00:07,346 DEBUG [Listener at localhost/34971] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:00:07,346 DEBUG [Listener at localhost/34971] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-25 17:00:07,346 DEBUG [Listener at localhost/34971] util.JVMClusterUtil(257): Found active master hash=1502260859, stopped=false 2023-08-25 17:00:07,346 INFO [Listener at localhost/34971] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44829,1692982745498 2023-08-25 17:00:07,350 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-25 17:00:07,350 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-25 17:00:07,350 INFO [Listener at localhost/34971] procedure2.ProcedureExecutor(629): Stopping 2023-08-25 17:00:07,350 DEBUG [Listener at localhost/34971] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c1aebea to 127.0.0.1:51927 2023-08-25 17:00:07,350 DEBUG [Listener at localhost/34971] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:00:07,350 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:00:07,351 INFO [Listener at localhost/34971] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38623,1692982745542' ***** 2023-08-25 17:00:07,351 INFO [Listener at localhost/34971] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-25 17:00:07,351 INFO [RS:0;jenkins-hbase4:38623] regionserver.HeapMemoryManager(220): Stopping 2023-08-25 17:00:07,351 INFO [RS:0;jenkins-hbase4:38623] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-25 17:00:07,351 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-25 17:00:07,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 17:00:07,352 INFO [RS:0;jenkins-hbase4:38623] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-25 17:00:07,352 INFO [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(3305): Received CLOSE for 7a2ed80ea85cdb555e5aa3f84b0ea5b9 2023-08-25 17:00:07,352 INFO [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(3305): Received CLOSE for fa1ff8433194ff0e12b460a5e9e26b38 2023-08-25 17:00:07,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7a2ed80ea85cdb555e5aa3f84b0ea5b9, disabling compactions & flushes 2023-08-25 17:00:07,353 INFO [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 17:00:07,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 17:00:07,353 DEBUG [RS:0;jenkins-hbase4:38623] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e943b08 to 127.0.0.1:51927 2023-08-25 17:00:07,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 17:00:07,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 17:00:07,353 DEBUG [RS:0;jenkins-hbase4:38623] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:00:07,353 INFO [RS:0;jenkins-hbase4:38623] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-25 17:00:07,353 INFO [RS:0;jenkins-hbase4:38623] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-25 17:00:07,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. after waiting 0 ms 2023-08-25 17:00:07,353 INFO [RS:0;jenkins-hbase4:38623] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-25 17:00:07,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 17:00:07,353 INFO [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-25 17:00:07,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7a2ed80ea85cdb555e5aa3f84b0ea5b9 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-25 17:00:07,354 INFO [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-08-25 17:00:07,354 DEBUG [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 7a2ed80ea85cdb555e5aa3f84b0ea5b9=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9., fa1ff8433194ff0e12b460a5e9e26b38=hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38.} 2023-08-25 17:00:07,354 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-25 17:00:07,354 DEBUG [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(1504): Waiting on 1588230740, 7a2ed80ea85cdb555e5aa3f84b0ea5b9, fa1ff8433194ff0e12b460a5e9e26b38 2023-08-25 17:00:07,354 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-25 17:00:07,354 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-25 17:00:07,355 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-25 17:00:07,355 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-25 17:00:07,355 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.10 KB heapSize=5.61 KB 2023-08-25 17:00:07,372 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.84 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/.tmp/info/de033bd155564796b3bc8689e109fd8b 2023-08-25 17:00:07,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=22 (bloomFilter=true), to=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/.tmp/info/1b0b14ef43f04f7791297a654c0c264c 2023-08-25 17:00:07,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/.tmp/info/1b0b14ef43f04f7791297a654c0c264c as hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/1b0b14ef43f04f7791297a654c0c264c 2023-08-25 17:00:07,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/1b0b14ef43f04f7791297a654c0c264c, entries=1, sequenceid=22, filesize=5.8 K 2023-08-25 17:00:07,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 7a2ed80ea85cdb555e5aa3f84b0ea5b9 in 44ms, sequenceid=22, compaction requested=true 2023-08-25 17:00:07,402 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/df191716eb2d4f7b999da68b4e827262, hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/7b637c80925e416d9b0946ff92befa91, hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/4c01981b84c34c98984cb728c6b340fd] to archive 2023-08-25 17:00:07,403 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-25 17:00:07,410 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=264 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/.tmp/table/e5d553e4b98443d0b2b9fe8b49edb60f 2023-08-25 17:00:07,412 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/df191716eb2d4f7b999da68b4e827262 to hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/df191716eb2d4f7b999da68b4e827262 2023-08-25 17:00:07,414 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/7b637c80925e416d9b0946ff92befa91 to hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/7b637c80925e416d9b0946ff92befa91 2023-08-25 17:00:07,417 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/4c01981b84c34c98984cb728c6b340fd to hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/info/4c01981b84c34c98984cb728c6b340fd 2023-08-25 17:00:07,420 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/.tmp/info/de033bd155564796b3bc8689e109fd8b as hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/info/de033bd155564796b3bc8689e109fd8b 2023-08-25 17:00:07,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/info/de033bd155564796b3bc8689e109fd8b, entries=20, sequenceid=14, filesize=7.6 K 2023-08-25 17:00:07,429 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/.tmp/table/e5d553e4b98443d0b2b9fe8b49edb60f as hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/table/e5d553e4b98443d0b2b9fe8b49edb60f 2023-08-25 17:00:07,435 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/table/e5d553e4b98443d0b2b9fe8b49edb60f, entries=4, sequenceid=14, filesize=4.9 K 2023-08-25 17:00:07,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.10 KB/3174, heapSize ~5.33 KB/5456, currentSize=0 B/0 for 1588230740 in 81ms, sequenceid=14, compaction requested=false 2023-08-25 17:00:07,448 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-08-25 17:00:07,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-25 17:00:07,450 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-25 17:00:07,450 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-25 17:00:07,450 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-25 17:00:07,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7a2ed80ea85cdb555e5aa3f84b0ea5b9/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2023-08-25 17:00:07,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 17:00:07,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7a2ed80ea85cdb555e5aa3f84b0ea5b9: 2023-08-25 17:00:07,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1692982746789.7a2ed80ea85cdb555e5aa3f84b0ea5b9. 2023-08-25 17:00:07,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fa1ff8433194ff0e12b460a5e9e26b38, disabling compactions & flushes 2023-08-25 17:00:07,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 17:00:07,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 17:00:07,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. after waiting 0 ms 2023-08-25 17:00:07,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 17:00:07,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/data/hbase/namespace/fa1ff8433194ff0e12b460a5e9e26b38/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-25 17:00:07,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 17:00:07,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fa1ff8433194ff0e12b460a5e9e26b38: 2023-08-25 17:00:07,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1692982746225.fa1ff8433194ff0e12b460a5e9e26b38. 2023-08-25 17:00:07,554 INFO [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38623,1692982745542; all regions closed. 2023-08-25 17:00:07,561 DEBUG [RS:0;jenkins-hbase4:38623] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/oldWALs 2023-08-25 17:00:07,561 INFO [RS:0;jenkins-hbase4:38623] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38623%2C1692982745542.meta:.meta(num 1692982746158) 2023-08-25 17:00:07,567 DEBUG [RS:0;jenkins-hbase4:38623] wal.AbstractFSWAL(1028): Moved 2 WAL file(s) to /user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/oldWALs 2023-08-25 17:00:07,567 INFO [RS:0;jenkins-hbase4:38623] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38623%2C1692982745542:(num 1692982807324) 2023-08-25 17:00:07,567 DEBUG [RS:0;jenkins-hbase4:38623] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:00:07,567 INFO [RS:0;jenkins-hbase4:38623] regionserver.LeaseManager(133): Closed leases 2023-08-25 17:00:07,567 INFO [RS:0;jenkins-hbase4:38623] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-08-25 17:00:07,567 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-25 17:00:07,568 INFO [RS:0;jenkins-hbase4:38623] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38623 2023-08-25 17:00:07,571 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38623,1692982745542 2023-08-25 17:00:07,571 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-25 17:00:07,571 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-25 17:00:07,572 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38623,1692982745542] 2023-08-25 17:00:07,573 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38623,1692982745542; numProcessing=1 2023-08-25 17:00:07,574 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38623,1692982745542 already deleted, retry=false 2023-08-25 17:00:07,574 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38623,1692982745542 expired; onlineServers=0 2023-08-25 17:00:07,574 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44829,1692982745498' ***** 2023-08-25 17:00:07,574 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-25 17:00:07,574 DEBUG [M:0;jenkins-hbase4:44829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5db53192, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-25 17:00:07,574 INFO [M:0;jenkins-hbase4:44829] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44829,1692982745498 2023-08-25 17:00:07,574 INFO [M:0;jenkins-hbase4:44829] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44829,1692982745498; all regions closed. 2023-08-25 17:00:07,574 DEBUG [M:0;jenkins-hbase4:44829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:00:07,574 DEBUG [M:0;jenkins-hbase4:44829] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-25 17:00:07,574 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-25 17:00:07,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1692982745746] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1692982745746,5,FailOnTimeoutGroup] 2023-08-25 17:00:07,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1692982745747] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1692982745747,5,FailOnTimeoutGroup] 2023-08-25 17:00:07,574 DEBUG [M:0;jenkins-hbase4:44829] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-25 17:00:07,575 INFO [M:0;jenkins-hbase4:44829] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-25 17:00:07,575 INFO [M:0;jenkins-hbase4:44829] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-25 17:00:07,575 INFO [M:0;jenkins-hbase4:44829] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-25 17:00:07,576 DEBUG [M:0;jenkins-hbase4:44829] master.HMaster(1512): Stopping service threads 2023-08-25 17:00:07,576 INFO [M:0;jenkins-hbase4:44829] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-25 17:00:07,576 ERROR [M:0;jenkins-hbase4:44829] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-08-25 17:00:07,576 INFO [M:0;jenkins-hbase4:44829] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-25 17:00:07,576 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-25 17:00:07,577 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-25 17:00:07,577 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:00:07,577 DEBUG [M:0;jenkins-hbase4:44829] zookeeper.ZKUtil(398): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-25 17:00:07,577 WARN [M:0;jenkins-hbase4:44829] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-25 17:00:07,577 INFO [M:0;jenkins-hbase4:44829] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-25 17:00:07,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-25 17:00:07,578 INFO [M:0;jenkins-hbase4:44829] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-25 17:00:07,578 DEBUG [M:0;jenkins-hbase4:44829] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-25 17:00:07,578 INFO [M:0;jenkins-hbase4:44829] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:00:07,578 DEBUG [M:0;jenkins-hbase4:44829] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:00:07,578 DEBUG [M:0;jenkins-hbase4:44829] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-25 17:00:07,578 DEBUG [M:0;jenkins-hbase4:44829] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:00:07,579 INFO [M:0;jenkins-hbase4:44829] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.89 KB heapSize=47.33 KB 2023-08-25 17:00:07,593 INFO [M:0;jenkins-hbase4:44829] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.89 KB at sequenceid=100 (bloomFilter=true), to=hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dd0f041597934b2cad9862622abd90cb 2023-08-25 17:00:07,599 INFO [M:0;jenkins-hbase4:44829] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd0f041597934b2cad9862622abd90cb 2023-08-25 17:00:07,600 DEBUG [M:0;jenkins-hbase4:44829] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dd0f041597934b2cad9862622abd90cb as hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dd0f041597934b2cad9862622abd90cb 2023-08-25 17:00:07,606 INFO [M:0;jenkins-hbase4:44829] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd0f041597934b2cad9862622abd90cb 2023-08-25 17:00:07,606 INFO [M:0;jenkins-hbase4:44829] regionserver.HStore(1080): Added hdfs://localhost:40879/user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dd0f041597934b2cad9862622abd90cb, entries=11, sequenceid=100, filesize=6.1 K 2023-08-25 17:00:07,607 INFO [M:0;jenkins-hbase4:44829] regionserver.HRegion(2948): Finished flush of dataSize ~38.89 KB/39824, heapSize ~47.31 KB/48448, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=100, compaction requested=false 2023-08-25 17:00:07,608 INFO [M:0;jenkins-hbase4:44829] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:00:07,608 DEBUG [M:0;jenkins-hbase4:44829] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-25 17:00:07,611 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/139da604-716d-0e37-5a17-97a6ce265674/MasterData/WALs/jenkins-hbase4.apache.org,44829,1692982745498/jenkins-hbase4.apache.org%2C44829%2C1692982745498.1692982745648 not finished, retry = 0 2023-08-25 17:00:07,673 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 17:00:07,673 INFO [RS:0;jenkins-hbase4:38623] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38623,1692982745542; zookeeper connection closed. 2023-08-25 17:00:07,673 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:38623-0x1004461d12b0001, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 17:00:07,674 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6aa18863] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6aa18863 2023-08-25 17:00:07,674 INFO [Listener at localhost/34971] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-25 17:00:07,712 INFO [M:0;jenkins-hbase4:44829] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-25 17:00:07,712 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-25 17:00:07,713 INFO [M:0;jenkins-hbase4:44829] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44829 2023-08-25 17:00:07,716 DEBUG [M:0;jenkins-hbase4:44829] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44829,1692982745498 already deleted, retry=false 2023-08-25 17:00:07,817 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 17:00:07,817 INFO [M:0;jenkins-hbase4:44829] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44829,1692982745498; zookeeper connection closed. 2023-08-25 17:00:07,818 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:44829-0x1004461d12b0000, quorum=127.0.0.1:51927, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 17:00:07,819 WARN [Listener at localhost/34971] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-25 17:00:07,822 INFO [Listener at localhost/34971] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 17:00:07,831 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-25 17:00:07,926 WARN [BP-1328453097-172.31.14.131-1692982744859 heartbeating to localhost/127.0.0.1:40879] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-25 17:00:07,926 WARN [BP-1328453097-172.31.14.131-1692982744859 heartbeating to localhost/127.0.0.1:40879] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1328453097-172.31.14.131-1692982744859 (Datanode Uuid 898866fc-fc87-483b-bb2a-6df7cfe471d0) service to localhost/127.0.0.1:40879 2023-08-25 17:00:07,926 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/cluster_a709966d-59b1-072e-90ea-2d14dfe30135/dfs/data/data3/current/BP-1328453097-172.31.14.131-1692982744859] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 17:00:07,927 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/cluster_a709966d-59b1-072e-90ea-2d14dfe30135/dfs/data/data4/current/BP-1328453097-172.31.14.131-1692982744859] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 17:00:07,928 WARN [Listener at localhost/34971] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-25 17:00:07,931 INFO [Listener at localhost/34971] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 17:00:08,034 WARN [BP-1328453097-172.31.14.131-1692982744859 heartbeating to localhost/127.0.0.1:40879] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-25 17:00:08,035 WARN [BP-1328453097-172.31.14.131-1692982744859 heartbeating to localhost/127.0.0.1:40879] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1328453097-172.31.14.131-1692982744859 (Datanode Uuid ef5cf1c0-7cbf-4c85-ba1e-69cb4b77ede7) service to localhost/127.0.0.1:40879 2023-08-25 17:00:08,035 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/cluster_a709966d-59b1-072e-90ea-2d14dfe30135/dfs/data/data1/current/BP-1328453097-172.31.14.131-1692982744859] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 17:00:08,035 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/cluster_a709966d-59b1-072e-90ea-2d14dfe30135/dfs/data/data2/current/BP-1328453097-172.31.14.131-1692982744859] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 17:00:08,047 INFO [Listener at localhost/34971] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 17:00:08,161 INFO [Listener at localhost/34971] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-25 17:00:08,177 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-25 17:00:08,186 INFO [Listener at localhost/34971] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=64 (was 78), OpenFileDescriptor=442 (was 467), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=129 (was 171), ProcessCount=170 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=7048 (was 6513) - AvailableMemoryMB LEAK? - 2023-08-25 17:00:08,196 INFO [Listener at localhost/34971] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=65, OpenFileDescriptor=442, MaxFileDescriptor=60000, SystemLoadAverage=129, ProcessCount=170, AvailableMemoryMB=7048 2023-08-25 17:00:08,196 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-25 17:00:08,197 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/hadoop.log.dir so I do NOT create it in target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e 2023-08-25 17:00:08,197 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e51cb775-aa16-6e90-15d3-a0c721d78555/hadoop.tmp.dir so I do NOT create it in target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e 2023-08-25 17:00:08,197 INFO [Listener at localhost/34971] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/cluster_0fc31d72-d2d0-bf14-3999-23a2d45691e4, deleteOnExit=true 2023-08-25 17:00:08,197 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-25 17:00:08,197 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/test.cache.data in system properties and HBase conf 2023-08-25 17:00:08,197 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/hadoop.tmp.dir in system properties and HBase conf 2023-08-25 17:00:08,197 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/hadoop.log.dir in system properties and HBase conf 2023-08-25 17:00:08,197 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-25 17:00:08,197 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-25 17:00:08,197 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-25 17:00:08,198 DEBUG [Listener at localhost/34971] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-25 17:00:08,198 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-25 17:00:08,198 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-25 17:00:08,198 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-25 17:00:08,198 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-25 17:00:08,198 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-25 17:00:08,198 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-25 17:00:08,199 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-25 17:00:08,199 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-25 17:00:08,199 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-25 17:00:08,199 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/nfs.dump.dir in system properties and HBase conf 2023-08-25 17:00:08,199 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/java.io.tmpdir in system properties and HBase conf 2023-08-25 17:00:08,199 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-25 17:00:08,199 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-25 17:00:08,199 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-25 17:00:08,203 WARN [Listener at localhost/34971] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-25 17:00:08,203 WARN [Listener at localhost/34971] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-25 17:00:08,242 WARN [Listener at localhost/34971] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 17:00:08,244 INFO [Listener at localhost/34971] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 17:00:08,248 INFO [Listener at localhost/34971] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/java.io.tmpdir/Jetty_localhost_35311_hdfs____8tbw63/webapp 2023-08-25 17:00:08,339 INFO [Listener at localhost/34971] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35311 2023-08-25 17:00:08,343 WARN [Listener at localhost/34971] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-25 17:00:08,344 WARN [Listener at localhost/34971] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-25 17:00:08,380 WARN [Listener at localhost/40743] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 17:00:08,393 WARN [Listener at localhost/40743] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-25 17:00:08,395 WARN [Listener at localhost/40743] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 17:00:08,396 INFO [Listener at localhost/40743] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 17:00:08,401 INFO [Listener at localhost/40743] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/java.io.tmpdir/Jetty_localhost_45511_datanode____bc84bf/webapp 2023-08-25 17:00:08,492 INFO [Listener at localhost/40743] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45511 2023-08-25 17:00:08,497 WARN [Listener at localhost/41077] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 17:00:08,509 WARN [Listener at localhost/41077] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-25 17:00:08,511 WARN [Listener at localhost/41077] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 17:00:08,512 INFO [Listener at localhost/41077] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 17:00:08,517 INFO [Listener at localhost/41077] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/java.io.tmpdir/Jetty_localhost_37063_datanode____8zs48g/webapp 2023-08-25 17:00:08,590 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb9f811a16d42284a: Processing first storage report for DS-0b5f20e2-3ce2-4940-ba36-aee05221b5aa from datanode b912f006-dddc-439a-acd1-b63e491198bf 2023-08-25 17:00:08,590 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb9f811a16d42284a: from storage DS-0b5f20e2-3ce2-4940-ba36-aee05221b5aa node DatanodeRegistration(127.0.0.1:37311, datanodeUuid=b912f006-dddc-439a-acd1-b63e491198bf, infoPort=39285, infoSecurePort=0, ipcPort=41077, storageInfo=lv=-57;cid=testClusterID;nsid=1296809484;c=1692982808206), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 17:00:08,590 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb9f811a16d42284a: Processing first storage report for DS-33b2645c-a2c1-48c6-bc6e-7d53de6aeb97 from datanode b912f006-dddc-439a-acd1-b63e491198bf 2023-08-25 17:00:08,590 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb9f811a16d42284a: from storage DS-33b2645c-a2c1-48c6-bc6e-7d53de6aeb97 node DatanodeRegistration(127.0.0.1:37311, datanodeUuid=b912f006-dddc-439a-acd1-b63e491198bf, infoPort=39285, infoSecurePort=0, ipcPort=41077, storageInfo=lv=-57;cid=testClusterID;nsid=1296809484;c=1692982808206), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-25 17:00:08,611 INFO [Listener at localhost/41077] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37063 2023-08-25 17:00:08,617 WARN [Listener at localhost/46709] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 17:00:08,702 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb6cc05a540084e1: Processing first storage report for DS-676c6434-5e7f-4d32-804d-5cc030102e4a from datanode c66e5d95-cf5d-4a4d-bbe0-0188aebd3ac1 2023-08-25 17:00:08,702 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb6cc05a540084e1: from storage DS-676c6434-5e7f-4d32-804d-5cc030102e4a node DatanodeRegistration(127.0.0.1:39639, datanodeUuid=c66e5d95-cf5d-4a4d-bbe0-0188aebd3ac1, infoPort=39123, infoSecurePort=0, ipcPort=46709, storageInfo=lv=-57;cid=testClusterID;nsid=1296809484;c=1692982808206), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 17:00:08,702 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb6cc05a540084e1: Processing first storage report for DS-daabd900-5ac5-4340-8888-b3ae99bdd6e7 from datanode c66e5d95-cf5d-4a4d-bbe0-0188aebd3ac1 2023-08-25 17:00:08,702 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb6cc05a540084e1: from storage DS-daabd900-5ac5-4340-8888-b3ae99bdd6e7 node DatanodeRegistration(127.0.0.1:39639, datanodeUuid=c66e5d95-cf5d-4a4d-bbe0-0188aebd3ac1, infoPort=39123, infoSecurePort=0, ipcPort=46709, storageInfo=lv=-57;cid=testClusterID;nsid=1296809484;c=1692982808206), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-25 17:00:08,728 DEBUG [Listener at localhost/46709] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e 2023-08-25 17:00:08,731 INFO [Listener at localhost/46709] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/cluster_0fc31d72-d2d0-bf14-3999-23a2d45691e4/zookeeper_0, clientPort=59206, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/cluster_0fc31d72-d2d0-bf14-3999-23a2d45691e4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/cluster_0fc31d72-d2d0-bf14-3999-23a2d45691e4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-25 17:00:08,732 INFO [Listener at localhost/46709] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59206 2023-08-25 17:00:08,732 INFO [Listener at localhost/46709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:00:08,733 INFO [Listener at localhost/46709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:00:08,749 INFO [Listener at localhost/46709] util.FSUtils(471): Created version file at hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b with version=8 2023-08-25 17:00:08,749 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/hbase-staging 2023-08-25 17:00:08,750 INFO [Listener at localhost/46709] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-25 17:00:08,751 INFO [Listener at localhost/46709] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 17:00:08,751 INFO [Listener at localhost/46709] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-25 17:00:08,751 INFO [Listener at localhost/46709] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-25 17:00:08,751 INFO [Listener at localhost/46709] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 17:00:08,751 INFO [Listener at localhost/46709] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-25 17:00:08,751 INFO [Listener at localhost/46709] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-25 17:00:08,752 INFO [Listener at localhost/46709] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44471 2023-08-25 17:00:08,752 INFO [Listener at localhost/46709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:00:08,753 INFO [Listener at localhost/46709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:00:08,754 INFO [Listener at localhost/46709] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44471 connecting to ZooKeeper ensemble=127.0.0.1:59206 2023-08-25 17:00:08,760 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:444710x0, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-25 17:00:08,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44471-0x1004462c8400000 connected 2023-08-25 17:00:08,775 DEBUG [Listener at localhost/46709] zookeeper.ZKUtil(164): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-25 17:00:08,776 DEBUG [Listener at localhost/46709] zookeeper.ZKUtil(164): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 17:00:08,776 DEBUG [Listener at localhost/46709] zookeeper.ZKUtil(164): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-25 17:00:08,776 DEBUG [Listener at localhost/46709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44471 2023-08-25 17:00:08,776 DEBUG [Listener at localhost/46709] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44471 2023-08-25 17:00:08,777 DEBUG [Listener at localhost/46709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44471 2023-08-25 17:00:08,781 DEBUG [Listener at localhost/46709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44471 2023-08-25 17:00:08,781 DEBUG [Listener at localhost/46709] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44471 2023-08-25 17:00:08,781 INFO [Listener at localhost/46709] master.HMaster(444): hbase.rootdir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b, hbase.cluster.distributed=false 2023-08-25 17:00:08,794 INFO [Listener at localhost/46709] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-25 17:00:08,794 INFO [Listener at localhost/46709] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 17:00:08,794 INFO [Listener at localhost/46709] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-25 17:00:08,795 INFO [Listener at localhost/46709] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-25 17:00:08,795 INFO [Listener at localhost/46709] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 17:00:08,795 INFO [Listener at localhost/46709] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-25 17:00:08,795 INFO [Listener at localhost/46709] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-25 17:00:08,796 INFO [Listener at localhost/46709] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39919 2023-08-25 17:00:08,796 INFO [Listener at localhost/46709] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-25 17:00:08,797 DEBUG [Listener at localhost/46709] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-25 17:00:08,797 INFO [Listener at localhost/46709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:00:08,798 INFO [Listener at localhost/46709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:00:08,799 INFO [Listener at localhost/46709] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39919 connecting to ZooKeeper ensemble=127.0.0.1:59206 2023-08-25 17:00:08,802 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): regionserver:399190x0, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-25 17:00:08,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39919-0x1004462c8400001 connected 2023-08-25 17:00:08,803 DEBUG [Listener at localhost/46709] zookeeper.ZKUtil(164): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-25 17:00:08,803 DEBUG [Listener at localhost/46709] zookeeper.ZKUtil(164): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 17:00:08,804 DEBUG [Listener at localhost/46709] zookeeper.ZKUtil(164): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-25 17:00:08,804 DEBUG [Listener at localhost/46709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39919 2023-08-25 17:00:08,804 DEBUG [Listener at localhost/46709] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39919 2023-08-25 17:00:08,805 DEBUG [Listener at localhost/46709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39919 2023-08-25 17:00:08,805 DEBUG [Listener at localhost/46709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39919 2023-08-25 17:00:08,805 DEBUG [Listener at localhost/46709] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39919 2023-08-25 17:00:08,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44471,1692982808750 2023-08-25 17:00:08,807 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-25 17:00:08,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44471,1692982808750 2023-08-25 17:00:08,809 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-25 17:00:08,809 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-25 17:00:08,809 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:00:08,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-25 17:00:08,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44471,1692982808750 from backup master directory 2023-08-25 17:00:08,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-25 17:00:08,812 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44471,1692982808750 2023-08-25 17:00:08,813 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-25 17:00:08,813 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-25 17:00:08,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44471,1692982808750 2023-08-25 17:00:08,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/hbase.id with ID: 04226c89-5d55-4a04-a6f0-45a78b1f3bb9 2023-08-25 17:00:08,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:00:08,842 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:00:08,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6f562296 to 127.0.0.1:59206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-25 17:00:08,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b911acc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-25 17:00:08,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-25 17:00:08,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-25 17:00:08,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 17:00:08,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/data/master/store-tmp 2023-08-25 17:00:08,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:00:08,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-25 17:00:08,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:00:08,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:00:08,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-25 17:00:08,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:00:08,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:00:08,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-25 17:00:08,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/WALs/jenkins-hbase4.apache.org,44471,1692982808750 2023-08-25 17:00:08,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44471%2C1692982808750, suffix=, logDir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/WALs/jenkins-hbase4.apache.org,44471,1692982808750, archiveDir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/oldWALs, maxLogs=10 2023-08-25 17:00:08,885 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39639,DS-676c6434-5e7f-4d32-804d-5cc030102e4a,DISK] 2023-08-25 17:00:08,886 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37311,DS-0b5f20e2-3ce2-4940-ba36-aee05221b5aa,DISK] 2023-08-25 17:00:08,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/WALs/jenkins-hbase4.apache.org,44471,1692982808750/jenkins-hbase4.apache.org%2C44471%2C1692982808750.1692982808870 2023-08-25 17:00:08,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39639,DS-676c6434-5e7f-4d32-804d-5cc030102e4a,DISK], DatanodeInfoWithStorage[127.0.0.1:37311,DS-0b5f20e2-3ce2-4940-ba36-aee05221b5aa,DISK]] 2023-08-25 17:00:08,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-25 17:00:08,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:00:08,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-25 17:00:08,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-25 17:00:08,894 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-25 17:00:08,895 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-25 17:00:08,896 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-25 17:00:08,896 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:00:08,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-25 17:00:08,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-25 17:00:08,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-25 17:00:08,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 17:00:08,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=828488, jitterRate=0.05347798764705658}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 17:00:08,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-25 17:00:08,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-25 17:00:08,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-25 17:00:08,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-25 17:00:08,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-25 17:00:08,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-25 17:00:08,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-25 17:00:08,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-25 17:00:08,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-25 17:00:08,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-25 17:00:08,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-25 17:00:08,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-25 17:00:08,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-25 17:00:08,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-25 17:00:08,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-25 17:00:08,919 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:00:08,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-25 17:00:08,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-25 17:00:08,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-25 17:00:08,922 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-25 17:00:08,922 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-25 17:00:08,922 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:00:08,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44471,1692982808750, sessionid=0x1004462c8400000, setting cluster-up flag (Was=false) 2023-08-25 17:00:08,926 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:00:08,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-25 17:00:08,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44471,1692982808750 2023-08-25 17:00:08,934 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:00:08,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-25 17:00:08,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44471,1692982808750 2023-08-25 17:00:08,941 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/.hbase-snapshot/.tmp 2023-08-25 17:00:08,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-25 17:00:08,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 17:00:08,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 17:00:08,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 17:00:08,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 17:00:08,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-25 17:00:08,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:00:08,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-25 17:00:08,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:00:08,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1692982838944 2023-08-25 17:00:08,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-25 17:00:08,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-25 17:00:08,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-25 17:00:08,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-25 17:00:08,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-25 17:00:08,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-25 17:00:08,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:08,946 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-25 17:00:08,946 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-25 17:00:08,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-25 17:00:08,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-25 17:00:08,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-25 17:00:08,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-25 17:00:08,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-25 17:00:08,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1692982808947,5,FailOnTimeoutGroup] 2023-08-25 17:00:08,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1692982808947,5,FailOnTimeoutGroup] 2023-08-25 17:00:08,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:08,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-25 17:00:08,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:08,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:08,948 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-25 17:00:08,958 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-25 17:00:08,959 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-25 17:00:08,959 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b 2023-08-25 17:00:08,968 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:00:08,969 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-25 17:00:08,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/info 2023-08-25 17:00:08,971 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-25 17:00:08,972 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:00:08,972 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-25 17:00:08,973 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/rep_barrier 2023-08-25 17:00:08,973 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-25 17:00:08,974 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:00:08,974 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-25 17:00:08,975 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/table 2023-08-25 17:00:08,975 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-25 17:00:08,976 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:00:08,977 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740 2023-08-25 17:00:08,977 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740 2023-08-25 17:00:08,979 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-25 17:00:08,980 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-25 17:00:08,983 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 17:00:08,984 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=820925, jitterRate=0.04386052489280701}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-25 17:00:08,984 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-25 17:00:08,984 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-25 17:00:08,984 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-25 17:00:08,984 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-25 17:00:08,984 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-25 17:00:08,984 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-25 17:00:08,984 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-25 17:00:08,984 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-25 17:00:08,985 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-25 17:00:08,985 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-25 17:00:08,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-25 17:00:08,987 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-25 17:00:08,988 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-25 17:00:09,007 INFO [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(951): ClusterId : 04226c89-5d55-4a04-a6f0-45a78b1f3bb9 2023-08-25 17:00:09,007 DEBUG [RS:0;jenkins-hbase4:39919] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-25 17:00:09,009 DEBUG [RS:0;jenkins-hbase4:39919] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-25 17:00:09,009 DEBUG [RS:0;jenkins-hbase4:39919] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-25 17:00:09,011 DEBUG [RS:0;jenkins-hbase4:39919] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-25 17:00:09,012 DEBUG [RS:0;jenkins-hbase4:39919] zookeeper.ReadOnlyZKClient(139): Connect 0x1a278da9 to 127.0.0.1:59206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-25 17:00:09,015 DEBUG [RS:0;jenkins-hbase4:39919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14e0709d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-25 17:00:09,015 DEBUG [RS:0;jenkins-hbase4:39919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10dfe6d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-25 17:00:09,024 DEBUG [RS:0;jenkins-hbase4:39919] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39919 2023-08-25 17:00:09,024 INFO [RS:0;jenkins-hbase4:39919] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-25 17:00:09,024 INFO [RS:0;jenkins-hbase4:39919] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-25 17:00:09,024 DEBUG [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(1022): About to register with Master. 2023-08-25 17:00:09,025 INFO [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44471,1692982808750 with isa=jenkins-hbase4.apache.org/172.31.14.131:39919, startcode=1692982808794 2023-08-25 17:00:09,025 DEBUG [RS:0;jenkins-hbase4:39919] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-25 17:00:09,027 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39775, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-08-25 17:00:09,028 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44471] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:09,029 DEBUG [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b 2023-08-25 17:00:09,029 DEBUG [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40743 2023-08-25 17:00:09,029 DEBUG [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-25 17:00:09,031 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-25 17:00:09,031 DEBUG [RS:0;jenkins-hbase4:39919] zookeeper.ZKUtil(162): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:09,031 WARN [RS:0;jenkins-hbase4:39919] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-25 17:00:09,031 INFO [RS:0;jenkins-hbase4:39919] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 17:00:09,031 DEBUG [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:09,032 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39919,1692982808794] 2023-08-25 17:00:09,038 DEBUG [RS:0;jenkins-hbase4:39919] zookeeper.ZKUtil(162): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:09,039 DEBUG [RS:0;jenkins-hbase4:39919] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-25 17:00:09,039 INFO [RS:0;jenkins-hbase4:39919] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-25 17:00:09,041 INFO [RS:0;jenkins-hbase4:39919] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-25 17:00:09,041 INFO [RS:0;jenkins-hbase4:39919] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-25 17:00:09,041 INFO [RS:0;jenkins-hbase4:39919] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:09,042 INFO [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-25 17:00:09,043 INFO [RS:0;jenkins-hbase4:39919] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:09,043 DEBUG [RS:0;jenkins-hbase4:39919] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:00:09,043 DEBUG [RS:0;jenkins-hbase4:39919] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:00:09,043 DEBUG [RS:0;jenkins-hbase4:39919] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:00:09,043 DEBUG [RS:0;jenkins-hbase4:39919] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:00:09,043 DEBUG [RS:0;jenkins-hbase4:39919] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:00:09,043 DEBUG [RS:0;jenkins-hbase4:39919] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-25 17:00:09,043 DEBUG [RS:0;jenkins-hbase4:39919] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:00:09,043 DEBUG [RS:0;jenkins-hbase4:39919] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:00:09,044 DEBUG [RS:0;jenkins-hbase4:39919] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:00:09,044 DEBUG [RS:0;jenkins-hbase4:39919] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:00:09,044 INFO [RS:0;jenkins-hbase4:39919] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:09,044 INFO [RS:0;jenkins-hbase4:39919] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:09,044 INFO [RS:0;jenkins-hbase4:39919] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:09,055 INFO [RS:0;jenkins-hbase4:39919] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-25 17:00:09,055 INFO [RS:0;jenkins-hbase4:39919] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39919,1692982808794-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:09,065 INFO [RS:0;jenkins-hbase4:39919] regionserver.Replication(203): jenkins-hbase4.apache.org,39919,1692982808794 started 2023-08-25 17:00:09,066 INFO [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39919,1692982808794, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39919, sessionid=0x1004462c8400001 2023-08-25 17:00:09,066 DEBUG [RS:0;jenkins-hbase4:39919] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-25 17:00:09,066 DEBUG [RS:0;jenkins-hbase4:39919] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:09,066 DEBUG [RS:0;jenkins-hbase4:39919] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39919,1692982808794' 2023-08-25 17:00:09,066 DEBUG [RS:0;jenkins-hbase4:39919] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 17:00:09,066 DEBUG [RS:0;jenkins-hbase4:39919] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 17:00:09,066 DEBUG [RS:0;jenkins-hbase4:39919] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-25 17:00:09,066 DEBUG [RS:0;jenkins-hbase4:39919] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-25 17:00:09,066 DEBUG [RS:0;jenkins-hbase4:39919] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:09,067 DEBUG [RS:0;jenkins-hbase4:39919] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39919,1692982808794' 2023-08-25 17:00:09,067 DEBUG [RS:0;jenkins-hbase4:39919] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-25 17:00:09,067 DEBUG [RS:0;jenkins-hbase4:39919] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-25 17:00:09,067 DEBUG [RS:0;jenkins-hbase4:39919] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-25 17:00:09,067 INFO [RS:0;jenkins-hbase4:39919] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-25 17:00:09,067 INFO [RS:0;jenkins-hbase4:39919] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-25 17:00:09,138 DEBUG [jenkins-hbase4:44471] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-25 17:00:09,139 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39919,1692982808794, state=OPENING 2023-08-25 17:00:09,141 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-25 17:00:09,142 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:00:09,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39919,1692982808794}] 2023-08-25 17:00:09,142 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-25 17:00:09,169 INFO [RS:0;jenkins-hbase4:39919] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39919%2C1692982808794, suffix=, logDir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794, archiveDir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/oldWALs, maxLogs=32 2023-08-25 17:00:09,185 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39639,DS-676c6434-5e7f-4d32-804d-5cc030102e4a,DISK] 2023-08-25 17:00:09,185 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37311,DS-0b5f20e2-3ce2-4940-ba36-aee05221b5aa,DISK] 2023-08-25 17:00:09,187 INFO [RS:0;jenkins-hbase4:39919] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794/jenkins-hbase4.apache.org%2C39919%2C1692982808794.1692982809170 2023-08-25 17:00:09,187 DEBUG [RS:0;jenkins-hbase4:39919] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39639,DS-676c6434-5e7f-4d32-804d-5cc030102e4a,DISK], DatanodeInfoWithStorage[127.0.0.1:37311,DS-0b5f20e2-3ce2-4940-ba36-aee05221b5aa,DISK]] 2023-08-25 17:00:09,297 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:09,297 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-25 17:00:09,299 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-25 17:00:09,303 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-25 17:00:09,303 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 17:00:09,305 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39919%2C1692982808794.meta, suffix=.meta, logDir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794, archiveDir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/oldWALs, maxLogs=32 2023-08-25 17:00:09,319 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37311,DS-0b5f20e2-3ce2-4940-ba36-aee05221b5aa,DISK] 2023-08-25 17:00:09,320 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39639,DS-676c6434-5e7f-4d32-804d-5cc030102e4a,DISK] 2023-08-25 17:00:09,322 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794/jenkins-hbase4.apache.org%2C39919%2C1692982808794.meta.1692982809305.meta 2023-08-25 17:00:09,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37311,DS-0b5f20e2-3ce2-4940-ba36-aee05221b5aa,DISK], DatanodeInfoWithStorage[127.0.0.1:39639,DS-676c6434-5e7f-4d32-804d-5cc030102e4a,DISK]] 2023-08-25 17:00:09,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-25 17:00:09,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-25 17:00:09,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-25 17:00:09,322 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-25 17:00:09,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-25 17:00:09,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:00:09,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-25 17:00:09,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-25 17:00:09,325 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-25 17:00:09,326 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/info 2023-08-25 17:00:09,326 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/info 2023-08-25 17:00:09,327 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-25 17:00:09,327 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:00:09,327 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-25 17:00:09,328 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/rep_barrier 2023-08-25 17:00:09,328 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/rep_barrier 2023-08-25 17:00:09,329 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-25 17:00:09,330 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:00:09,330 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-25 17:00:09,331 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/table 2023-08-25 17:00:09,331 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/table 2023-08-25 17:00:09,331 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-25 17:00:09,332 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:00:09,333 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740 2023-08-25 17:00:09,334 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740 2023-08-25 17:00:09,337 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-25 17:00:09,338 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-25 17:00:09,339 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=758975, jitterRate=-0.03491440415382385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-25 17:00:09,339 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-25 17:00:09,340 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1692982809296 2023-08-25 17:00:09,343 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-25 17:00:09,343 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-25 17:00:09,344 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39919,1692982808794, state=OPEN 2023-08-25 17:00:09,347 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-25 17:00:09,347 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-25 17:00:09,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-25 17:00:09,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39919,1692982808794 in 205 msec 2023-08-25 17:00:09,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-25 17:00:09,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 364 msec 2023-08-25 17:00:09,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 411 msec 2023-08-25 17:00:09,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1692982809353, completionTime=-1 2023-08-25 17:00:09,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-25 17:00:09,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-25 17:00:09,356 DEBUG [hconnection-0x35f6fb73-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-25 17:00:09,357 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-25 17:00:09,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-25 17:00:09,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1692982869359 2023-08-25 17:00:09,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1692982929359 2023-08-25 17:00:09,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-08-25 17:00:09,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44471,1692982808750-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:09,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44471,1692982808750-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:09,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44471,1692982808750-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:09,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44471, period=300000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:09,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-25 17:00:09,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-25 17:00:09,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-25 17:00:09,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-25 17:00:09,366 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-25 17:00:09,367 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-25 17:00:09,368 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-25 17:00:09,369 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/.tmp/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c 2023-08-25 17:00:09,370 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/.tmp/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c empty. 2023-08-25 17:00:09,370 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/.tmp/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c 2023-08-25 17:00:09,370 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-25 17:00:09,381 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-25 17:00:09,382 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 469f30df4f0d73a5b5ab554fabb8011c, NAME => 'hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/.tmp 2023-08-25 17:00:09,393 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:00:09,393 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 469f30df4f0d73a5b5ab554fabb8011c, disabling compactions & flushes 2023-08-25 17:00:09,393 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. 2023-08-25 17:00:09,393 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. 2023-08-25 17:00:09,393 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. after waiting 0 ms 2023-08-25 17:00:09,393 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. 2023-08-25 17:00:09,393 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. 2023-08-25 17:00:09,394 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 469f30df4f0d73a5b5ab554fabb8011c: 2023-08-25 17:00:09,396 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-25 17:00:09,397 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692982809397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692982809397"}]},"ts":"1692982809397"} 2023-08-25 17:00:09,399 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-25 17:00:09,400 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-25 17:00:09,401 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982809400"}]},"ts":"1692982809400"} 2023-08-25 17:00:09,402 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-25 17:00:09,410 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=469f30df4f0d73a5b5ab554fabb8011c, ASSIGN}] 2023-08-25 17:00:09,411 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=469f30df4f0d73a5b5ab554fabb8011c, ASSIGN 2023-08-25 17:00:09,412 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=469f30df4f0d73a5b5ab554fabb8011c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39919,1692982808794; forceNewPlan=false, retain=false 2023-08-25 17:00:09,563 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=469f30df4f0d73a5b5ab554fabb8011c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:09,563 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692982809563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1692982809563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692982809563"}]},"ts":"1692982809563"} 2023-08-25 17:00:09,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 469f30df4f0d73a5b5ab554fabb8011c, server=jenkins-hbase4.apache.org,39919,1692982808794}] 2023-08-25 17:00:09,722 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. 2023-08-25 17:00:09,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 469f30df4f0d73a5b5ab554fabb8011c, NAME => 'hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c.', STARTKEY => '', ENDKEY => ''} 2023-08-25 17:00:09,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 469f30df4f0d73a5b5ab554fabb8011c 2023-08-25 17:00:09,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:00:09,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 469f30df4f0d73a5b5ab554fabb8011c 2023-08-25 17:00:09,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 469f30df4f0d73a5b5ab554fabb8011c 2023-08-25 17:00:09,724 INFO [StoreOpener-469f30df4f0d73a5b5ab554fabb8011c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 469f30df4f0d73a5b5ab554fabb8011c 2023-08-25 17:00:09,725 DEBUG [StoreOpener-469f30df4f0d73a5b5ab554fabb8011c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c/info 2023-08-25 17:00:09,725 DEBUG [StoreOpener-469f30df4f0d73a5b5ab554fabb8011c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c/info 2023-08-25 17:00:09,726 INFO [StoreOpener-469f30df4f0d73a5b5ab554fabb8011c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 469f30df4f0d73a5b5ab554fabb8011c columnFamilyName info 2023-08-25 17:00:09,726 INFO [StoreOpener-469f30df4f0d73a5b5ab554fabb8011c-1] regionserver.HStore(310): Store=469f30df4f0d73a5b5ab554fabb8011c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:00:09,727 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c 2023-08-25 17:00:09,728 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c 2023-08-25 17:00:09,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 469f30df4f0d73a5b5ab554fabb8011c 2023-08-25 17:00:09,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 17:00:09,733 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 469f30df4f0d73a5b5ab554fabb8011c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=711249, jitterRate=-0.09560048580169678}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 17:00:09,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 469f30df4f0d73a5b5ab554fabb8011c: 2023-08-25 17:00:09,733 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c., pid=6, masterSystemTime=1692982809718 2023-08-25 17:00:09,735 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. 2023-08-25 17:00:09,736 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. 2023-08-25 17:00:09,736 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=469f30df4f0d73a5b5ab554fabb8011c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:09,737 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692982809736"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1692982809736"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692982809736"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692982809736"}]},"ts":"1692982809736"} 2023-08-25 17:00:09,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-25 17:00:09,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 469f30df4f0d73a5b5ab554fabb8011c, server=jenkins-hbase4.apache.org,39919,1692982808794 in 172 msec 2023-08-25 17:00:09,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-25 17:00:09,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=469f30df4f0d73a5b5ab554fabb8011c, ASSIGN in 330 msec 2023-08-25 17:00:09,743 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-25 17:00:09,743 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982809743"}]},"ts":"1692982809743"} 2023-08-25 17:00:09,745 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-25 17:00:09,747 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-25 17:00:09,748 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 382 msec 2023-08-25 17:00:09,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-25 17:00:09,769 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-25 17:00:09,769 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:00:09,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-25 17:00:09,781 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-25 17:00:09,785 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-08-25 17:00:09,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-25 17:00:09,802 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-25 17:00:09,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-08-25 17:00:09,819 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-25 17:00:09,824 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-25 17:00:09,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.011sec 2023-08-25 17:00:09,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-25 17:00:09,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-25 17:00:09,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-25 17:00:09,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44471,1692982808750-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-25 17:00:09,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44471,1692982808750-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-25 17:00:09,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-25 17:00:09,907 DEBUG [Listener at localhost/46709] zookeeper.ReadOnlyZKClient(139): Connect 0x14ca54dd to 127.0.0.1:59206 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-25 17:00:09,912 DEBUG [Listener at localhost/46709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22560fd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-25 17:00:09,913 DEBUG [hconnection-0x16a18798-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-25 17:00:09,915 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-25 17:00:09,917 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44471,1692982808750 2023-08-25 17:00:09,917 INFO [Listener at localhost/46709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:00:09,921 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-25 17:00:09,921 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:00:09,921 INFO [Listener at localhost/46709] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-25 17:00:09,923 DEBUG [Listener at localhost/46709] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-25 17:00:09,925 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-25 17:00:09,927 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44471] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-25 17:00:09,927 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44471] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-25 17:00:09,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44471] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-25 17:00:09,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44471] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRolling 2023-08-25 17:00:09,930 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-08-25 17:00:09,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44471] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRolling" procId is: 9 2023-08-25 17:00:09,933 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-25 17:00:09,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44471] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-25 17:00:09,935 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/.tmp/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:09,935 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/.tmp/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5 empty. 2023-08-25 17:00:09,936 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/.tmp/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:09,936 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRolling regions 2023-08-25 17:00:09,951 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/.tmp/data/default/TestLogRolling-testLogRolling/.tabledesc/.tableinfo.0000000001 2023-08-25 17:00:09,952 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => f28eb01c00ac51074e0973e8c7ef03b5, NAME => 'TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/.tmp 2023-08-25 17:00:09,960 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:00:09,961 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1604): Closing f28eb01c00ac51074e0973e8c7ef03b5, disabling compactions & flushes 2023-08-25 17:00:09,961 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:09,961 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:09,961 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. after waiting 0 ms 2023-08-25 17:00:09,961 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:09,961 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:09,961 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1558): Region close journal for f28eb01c00ac51074e0973e8c7ef03b5: 2023-08-25 17:00:09,963 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ADD_TO_META 2023-08-25 17:00:09,964 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1692982809964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692982809964"}]},"ts":"1692982809964"} 2023-08-25 17:00:09,966 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-25 17:00:09,967 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-25 17:00:09,967 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982809967"}]},"ts":"1692982809967"} 2023-08-25 17:00:09,968 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLING in hbase:meta 2023-08-25 17:00:09,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f28eb01c00ac51074e0973e8c7ef03b5, ASSIGN}] 2023-08-25 17:00:09,974 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f28eb01c00ac51074e0973e8c7ef03b5, ASSIGN 2023-08-25 17:00:09,974 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f28eb01c00ac51074e0973e8c7ef03b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39919,1692982808794; forceNewPlan=false, retain=false 2023-08-25 17:00:10,126 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f28eb01c00ac51074e0973e8c7ef03b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:10,126 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1692982810125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1692982810125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692982810125"}]},"ts":"1692982810125"} 2023-08-25 17:00:10,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f28eb01c00ac51074e0973e8c7ef03b5, server=jenkins-hbase4.apache.org,39919,1692982808794}] 2023-08-25 17:00:10,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:10,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f28eb01c00ac51074e0973e8c7ef03b5, NAME => 'TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.', STARTKEY => '', ENDKEY => ''} 2023-08-25 17:00:10,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:10,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:00:10,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:10,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:10,286 INFO [StoreOpener-f28eb01c00ac51074e0973e8c7ef03b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:10,287 DEBUG [StoreOpener-f28eb01c00ac51074e0973e8c7ef03b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info 2023-08-25 17:00:10,287 DEBUG [StoreOpener-f28eb01c00ac51074e0973e8c7ef03b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info 2023-08-25 17:00:10,288 INFO [StoreOpener-f28eb01c00ac51074e0973e8c7ef03b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f28eb01c00ac51074e0973e8c7ef03b5 columnFamilyName info 2023-08-25 17:00:10,288 INFO [StoreOpener-f28eb01c00ac51074e0973e8c7ef03b5-1] regionserver.HStore(310): Store=f28eb01c00ac51074e0973e8c7ef03b5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:00:10,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:10,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:10,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:10,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 17:00:10,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f28eb01c00ac51074e0973e8c7ef03b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=717011, jitterRate=-0.08827391266822815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 17:00:10,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f28eb01c00ac51074e0973e8c7ef03b5: 2023-08-25 17:00:10,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5., pid=11, masterSystemTime=1692982810280 2023-08-25 17:00:10,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:10,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:10,300 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f28eb01c00ac51074e0973e8c7ef03b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:10,301 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1692982810300"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1692982810300"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692982810300"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692982810300"}]},"ts":"1692982810300"} 2023-08-25 17:00:10,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-25 17:00:10,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f28eb01c00ac51074e0973e8c7ef03b5, server=jenkins-hbase4.apache.org,39919,1692982808794 in 175 msec 2023-08-25 17:00:10,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-25 17:00:10,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f28eb01c00ac51074e0973e8c7ef03b5, ASSIGN in 333 msec 2023-08-25 17:00:10,309 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-25 17:00:10,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982810309"}]},"ts":"1692982810309"} 2023-08-25 17:00:10,310 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLED in hbase:meta 2023-08-25 17:00:10,313 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_POST_OPERATION 2023-08-25 17:00:10,314 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRolling in 386 msec 2023-08-25 17:00:12,975 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-25 17:00:15,039 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-25 17:00:15,040 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-25 17:00:15,040 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRolling' 2023-08-25 17:00:19,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44471] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-25 17:00:19,935 INFO [Listener at localhost/46709] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRolling, procId: 9 completed 2023-08-25 17:00:19,937 DEBUG [Listener at localhost/46709] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRolling 2023-08-25 17:00:19,937 DEBUG [Listener at localhost/46709] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:19,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:19,952 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing f28eb01c00ac51074e0973e8c7ef03b5 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-25 17:00:19,973 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=12 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/6566a3b06e0548509b39a17e57539eee 2023-08-25 17:00:19,981 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/6566a3b06e0548509b39a17e57539eee as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/6566a3b06e0548509b39a17e57539eee 2023-08-25 17:00:19,981 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=f28eb01c00ac51074e0973e8c7ef03b5, server=jenkins-hbase4.apache.org,39919,1692982808794 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-25 17:00:19,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] ipc.CallRunner(144): callId: 38 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:34018 deadline: 1692982829980, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=f28eb01c00ac51074e0973e8c7ef03b5, server=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:19,986 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/6566a3b06e0548509b39a17e57539eee, entries=8, sequenceid=12, filesize=13.0 K 2023-08-25 17:00:19,988 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for f28eb01c00ac51074e0973e8c7ef03b5 in 36ms, sequenceid=12, compaction requested=false 2023-08-25 17:00:19,988 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for f28eb01c00ac51074e0973e8c7ef03b5: 2023-08-25 17:00:30,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:30,102 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing f28eb01c00ac51074e0973e8c7ef03b5 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-25 17:00:30,117 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=37 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/2b1f4b80d4984f17bf07b385f370ef25 2023-08-25 17:00:30,124 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/2b1f4b80d4984f17bf07b385f370ef25 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2b1f4b80d4984f17bf07b385f370ef25 2023-08-25 17:00:30,131 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2b1f4b80d4984f17bf07b385f370ef25, entries=22, sequenceid=37, filesize=27.4 K 2023-08-25 17:00:30,132 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for f28eb01c00ac51074e0973e8c7ef03b5 in 30ms, sequenceid=37, compaction requested=false 2023-08-25 17:00:30,132 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for f28eb01c00ac51074e0973e8c7ef03b5: 2023-08-25 17:00:30,132 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=40.3 K, sizeToCheck=16.0 K 2023-08-25 17:00:30,132 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-25 17:00:30,134 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2b1f4b80d4984f17bf07b385f370ef25 because midkey is the same as first or last row 2023-08-25 17:00:32,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:32,115 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing f28eb01c00ac51074e0973e8c7ef03b5 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-25 17:00:32,134 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=48 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/558a80bd350a4a9da748b495b0f1f952 2023-08-25 17:00:32,142 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/558a80bd350a4a9da748b495b0f1f952 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/558a80bd350a4a9da748b495b0f1f952 2023-08-25 17:00:32,149 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/558a80bd350a4a9da748b495b0f1f952, entries=8, sequenceid=48, filesize=13.0 K 2023-08-25 17:00:32,149 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for f28eb01c00ac51074e0973e8c7ef03b5 in 34ms, sequenceid=48, compaction requested=true 2023-08-25 17:00:32,150 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for f28eb01c00ac51074e0973e8c7ef03b5: 2023-08-25 17:00:32,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:32,150 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=53.3 K, sizeToCheck=16.0 K 2023-08-25 17:00:32,150 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-25 17:00:32,150 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2b1f4b80d4984f17bf07b385f370ef25 because midkey is the same as first or last row 2023-08-25 17:00:32,151 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:32,151 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-25 17:00:32,152 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing f28eb01c00ac51074e0973e8c7ef03b5 1/1 column families, dataSize=23.61 KB heapSize=25.59 KB 2023-08-25 17:00:32,154 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 54576 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-25 17:00:32,154 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1912): f28eb01c00ac51074e0973e8c7ef03b5/info is initiating minor compaction (all files) 2023-08-25 17:00:32,154 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f28eb01c00ac51074e0973e8c7ef03b5/info in TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:32,154 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/6566a3b06e0548509b39a17e57539eee, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2b1f4b80d4984f17bf07b385f370ef25, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/558a80bd350a4a9da748b495b0f1f952] into tmpdir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp, totalSize=53.3 K 2023-08-25 17:00:32,156 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 6566a3b06e0548509b39a17e57539eee, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1692982819941 2023-08-25 17:00:32,157 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 2b1f4b80d4984f17bf07b385f370ef25, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=37, earliestPutTs=1692982819953 2023-08-25 17:00:32,158 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 558a80bd350a4a9da748b495b0f1f952, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1692982830103 2023-08-25 17:00:32,166 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=23.61 KB at sequenceid=74 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/be0d103d4ee34c3bb558e855b70d7f9f 2023-08-25 17:00:32,174 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/be0d103d4ee34c3bb558e855b70d7f9f as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/be0d103d4ee34c3bb558e855b70d7f9f 2023-08-25 17:00:32,178 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] throttle.PressureAwareThroughputController(145): f28eb01c00ac51074e0973e8c7ef03b5#info#compaction#19 average throughput is 19.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-25 17:00:32,180 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/be0d103d4ee34c3bb558e855b70d7f9f, entries=23, sequenceid=74, filesize=28.4 K 2023-08-25 17:00:32,181 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~23.61 KB/24173, heapSize ~25.57 KB/26184, currentSize=3.08 KB/3153 for f28eb01c00ac51074e0973e8c7ef03b5 in 30ms, sequenceid=74, compaction requested=false 2023-08-25 17:00:32,181 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for f28eb01c00ac51074e0973e8c7ef03b5: 2023-08-25 17:00:32,181 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=81.7 K, sizeToCheck=16.0 K 2023-08-25 17:00:32,181 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-25 17:00:32,182 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/be0d103d4ee34c3bb558e855b70d7f9f because midkey is the same as first or last row 2023-08-25 17:00:32,196 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/9a2c15406456404f9859810c55883ebc as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/9a2c15406456404f9859810c55883ebc 2023-08-25 17:00:32,202 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f28eb01c00ac51074e0973e8c7ef03b5/info of f28eb01c00ac51074e0973e8c7ef03b5 into 9a2c15406456404f9859810c55883ebc(size=43.9 K), total size for store is 72.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-25 17:00:32,202 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f28eb01c00ac51074e0973e8c7ef03b5: 2023-08-25 17:00:32,202 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5., storeName=f28eb01c00ac51074e0973e8c7ef03b5/info, priority=13, startTime=1692982832151; duration=0sec 2023-08-25 17:00:32,203 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=72.3 K, sizeToCheck=16.0 K 2023-08-25 17:00:32,203 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-25 17:00:32,203 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.StoreUtils(129): cannot split hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/9a2c15406456404f9859810c55883ebc because midkey is the same as first or last row 2023-08-25 17:00:32,203 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:34,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:34,163 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing f28eb01c00ac51074e0973e8c7ef03b5 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-25 17:00:34,175 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=86 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/6d6a15ade8074498ad48222de25e122c 2023-08-25 17:00:34,182 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/6d6a15ade8074498ad48222de25e122c as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/6d6a15ade8074498ad48222de25e122c 2023-08-25 17:00:34,187 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/6d6a15ade8074498ad48222de25e122c, entries=8, sequenceid=86, filesize=13.0 K 2023-08-25 17:00:34,188 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=19.50 KB/19969 for f28eb01c00ac51074e0973e8c7ef03b5 in 25ms, sequenceid=86, compaction requested=true 2023-08-25 17:00:34,188 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for f28eb01c00ac51074e0973e8c7ef03b5: 2023-08-25 17:00:34,189 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=85.3 K, sizeToCheck=16.0 K 2023-08-25 17:00:34,189 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-25 17:00:34,189 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/9a2c15406456404f9859810c55883ebc because midkey is the same as first or last row 2023-08-25 17:00:34,189 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:34,189 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-25 17:00:34,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:34,190 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing f28eb01c00ac51074e0973e8c7ef03b5 1/1 column families, dataSize=20.53 KB heapSize=22.28 KB 2023-08-25 17:00:34,190 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 87347 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-25 17:00:34,191 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1912): f28eb01c00ac51074e0973e8c7ef03b5/info is initiating minor compaction (all files) 2023-08-25 17:00:34,191 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f28eb01c00ac51074e0973e8c7ef03b5/info in TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:34,191 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/9a2c15406456404f9859810c55883ebc, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/be0d103d4ee34c3bb558e855b70d7f9f, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/6d6a15ade8074498ad48222de25e122c] into tmpdir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp, totalSize=85.3 K 2023-08-25 17:00:34,191 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 9a2c15406456404f9859810c55883ebc, keycount=38, bloomtype=ROW, size=43.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1692982819941 2023-08-25 17:00:34,192 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting be0d103d4ee34c3bb558e855b70d7f9f, keycount=23, bloomtype=ROW, size=28.4 K, encoding=NONE, compression=NONE, seqNum=74, earliestPutTs=1692982832115 2023-08-25 17:00:34,192 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 6d6a15ade8074498ad48222de25e122c, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=86, earliestPutTs=1692982832152 2023-08-25 17:00:34,205 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=20.53 KB at sequenceid=109 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/d416d432c6854097b6c992b0b05c8d73 2023-08-25 17:00:34,210 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] throttle.PressureAwareThroughputController(145): f28eb01c00ac51074e0973e8c7ef03b5#info#compaction#22 average throughput is 17.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-25 17:00:34,212 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/d416d432c6854097b6c992b0b05c8d73 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/d416d432c6854097b6c992b0b05c8d73 2023-08-25 17:00:34,222 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/d416d432c6854097b6c992b0b05c8d73, entries=20, sequenceid=109, filesize=25.3 K 2023-08-25 17:00:34,222 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~20.53 KB/21020, heapSize ~22.27 KB/22800, currentSize=7.18 KB/7357 for f28eb01c00ac51074e0973e8c7ef03b5 in 33ms, sequenceid=109, compaction requested=false 2023-08-25 17:00:34,223 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for f28eb01c00ac51074e0973e8c7ef03b5: 2023-08-25 17:00:34,223 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=110.6 K, sizeToCheck=16.0 K 2023-08-25 17:00:34,223 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-25 17:00:34,223 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/9a2c15406456404f9859810c55883ebc because midkey is the same as first or last row 2023-08-25 17:00:34,225 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/2643fa95c12d40e7ae0e058ca0cc38f9 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2643fa95c12d40e7ae0e058ca0cc38f9 2023-08-25 17:00:34,231 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f28eb01c00ac51074e0973e8c7ef03b5/info of f28eb01c00ac51074e0973e8c7ef03b5 into 2643fa95c12d40e7ae0e058ca0cc38f9(size=76.0 K), total size for store is 101.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-25 17:00:34,231 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f28eb01c00ac51074e0973e8c7ef03b5: 2023-08-25 17:00:34,231 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5., storeName=f28eb01c00ac51074e0973e8c7ef03b5/info, priority=13, startTime=1692982834189; duration=0sec 2023-08-25 17:00:34,231 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=101.3 K, sizeToCheck=16.0 K 2023-08-25 17:00:34,231 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-25 17:00:34,232 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit(227): Splitting TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5., compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:34,232 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:34,233 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44471] assignment.AssignmentManager(1140): Split request from jenkins-hbase4.apache.org,39919,1692982808794, parent={ENCODED => f28eb01c00ac51074e0973e8c7ef03b5, NAME => 'TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.', STARTKEY => '', ENDKEY => ''} splitKey=row0064 2023-08-25 17:00:34,241 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44471] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:34,247 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44471] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=f28eb01c00ac51074e0973e8c7ef03b5, daughterA=b47a3ed0187be817b6f5b11a8ecb6514, daughterB=cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:34,247 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=f28eb01c00ac51074e0973e8c7ef03b5, daughterA=b47a3ed0187be817b6f5b11a8ecb6514, daughterB=cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:34,248 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=f28eb01c00ac51074e0973e8c7ef03b5, daughterA=b47a3ed0187be817b6f5b11a8ecb6514, daughterB=cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:34,248 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=f28eb01c00ac51074e0973e8c7ef03b5, daughterA=b47a3ed0187be817b6f5b11a8ecb6514, daughterB=cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:34,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f28eb01c00ac51074e0973e8c7ef03b5, UNASSIGN}] 2023-08-25 17:00:34,256 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f28eb01c00ac51074e0973e8c7ef03b5, UNASSIGN 2023-08-25 17:00:34,257 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f28eb01c00ac51074e0973e8c7ef03b5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:34,257 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1692982834257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1692982834257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692982834257"}]},"ts":"1692982834257"} 2023-08-25 17:00:34,259 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; CloseRegionProcedure f28eb01c00ac51074e0973e8c7ef03b5, server=jenkins-hbase4.apache.org,39919,1692982808794}] 2023-08-25 17:00:34,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:34,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f28eb01c00ac51074e0973e8c7ef03b5, disabling compactions & flushes 2023-08-25 17:00:34,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:34,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:34,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. after waiting 0 ms 2023-08-25 17:00:34,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:34,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f28eb01c00ac51074e0973e8c7ef03b5 1/1 column families, dataSize=7.18 KB heapSize=7.96 KB 2023-08-25 17:00:34,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=7.18 KB at sequenceid=120 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/48541388bd0a41bfaf7d789bbf1d9184 2023-08-25 17:00:34,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.tmp/info/48541388bd0a41bfaf7d789bbf1d9184 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/48541388bd0a41bfaf7d789bbf1d9184 2023-08-25 17:00:34,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/48541388bd0a41bfaf7d789bbf1d9184, entries=7, sequenceid=120, filesize=11.9 K 2023-08-25 17:00:34,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~7.18 KB/7357, heapSize ~7.95 KB/8136, currentSize=0 B/0 for f28eb01c00ac51074e0973e8c7ef03b5 in 24ms, sequenceid=120, compaction requested=true 2023-08-25 17:00:34,448 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/6566a3b06e0548509b39a17e57539eee, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2b1f4b80d4984f17bf07b385f370ef25, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/9a2c15406456404f9859810c55883ebc, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/558a80bd350a4a9da748b495b0f1f952, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/be0d103d4ee34c3bb558e855b70d7f9f, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/6d6a15ade8074498ad48222de25e122c] to archive 2023-08-25 17:00:34,449 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-25 17:00:34,451 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/6566a3b06e0548509b39a17e57539eee to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/6566a3b06e0548509b39a17e57539eee 2023-08-25 17:00:34,452 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2b1f4b80d4984f17bf07b385f370ef25 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2b1f4b80d4984f17bf07b385f370ef25 2023-08-25 17:00:34,454 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/9a2c15406456404f9859810c55883ebc to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/9a2c15406456404f9859810c55883ebc 2023-08-25 17:00:34,455 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/558a80bd350a4a9da748b495b0f1f952 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/558a80bd350a4a9da748b495b0f1f952 2023-08-25 17:00:34,456 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/be0d103d4ee34c3bb558e855b70d7f9f to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/be0d103d4ee34c3bb558e855b70d7f9f 2023-08-25 17:00:34,458 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/6d6a15ade8074498ad48222de25e122c to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/6d6a15ade8074498ad48222de25e122c 2023-08-25 17:00:34,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/recovered.edits/123.seqid, newMaxSeqId=123, maxSeqId=1 2023-08-25 17:00:34,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. 2023-08-25 17:00:34,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f28eb01c00ac51074e0973e8c7ef03b5: 2023-08-25 17:00:34,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:34,466 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f28eb01c00ac51074e0973e8c7ef03b5, regionState=CLOSED 2023-08-25 17:00:34,467 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1692982834466"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692982834466"}]},"ts":"1692982834466"} 2023-08-25 17:00:34,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-08-25 17:00:34,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; CloseRegionProcedure f28eb01c00ac51074e0973e8c7ef03b5, server=jenkins-hbase4.apache.org,39919,1692982808794 in 209 msec 2023-08-25 17:00:34,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-08-25 17:00:34,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=f28eb01c00ac51074e0973e8c7ef03b5, UNASSIGN in 215 msec 2023-08-25 17:00:34,484 INFO [PEWorker-4] assignment.SplitTableRegionProcedure(694): pid=12 splitting 3 storefiles, region=f28eb01c00ac51074e0973e8c7ef03b5, threads=3 2023-08-25 17:00:34,484 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2643fa95c12d40e7ae0e058ca0cc38f9 for region: f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:34,485 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/48541388bd0a41bfaf7d789bbf1d9184 for region: f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:34,485 DEBUG [StoreFileSplitter-pool-2] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/d416d432c6854097b6c992b0b05c8d73 for region: f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:34,494 DEBUG [StoreFileSplitter-pool-2] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/d416d432c6854097b6c992b0b05c8d73, top=true 2023-08-25 17:00:34,495 DEBUG [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/48541388bd0a41bfaf7d789bbf1d9184, top=true 2023-08-25 17:00:34,503 INFO [StoreFileSplitter-pool-2] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.splits/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-d416d432c6854097b6c992b0b05c8d73 for child: cb19b2ddc803809f3b21f9ccc1a6ebdc, parent: f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:34,503 DEBUG [StoreFileSplitter-pool-2] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/d416d432c6854097b6c992b0b05c8d73 for region: f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:34,504 INFO [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/.splits/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-48541388bd0a41bfaf7d789bbf1d9184 for child: cb19b2ddc803809f3b21f9ccc1a6ebdc, parent: f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:34,504 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/48541388bd0a41bfaf7d789bbf1d9184 for region: f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:34,520 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2643fa95c12d40e7ae0e058ca0cc38f9 for region: f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:00:34,520 DEBUG [PEWorker-4] assignment.SplitTableRegionProcedure(755): pid=12 split storefiles for region f28eb01c00ac51074e0973e8c7ef03b5 Daughter A: 1 storefiles, Daughter B: 3 storefiles. 2023-08-25 17:00:34,549 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514/recovered.edits/123.seqid, newMaxSeqId=123, maxSeqId=-1 2023-08-25 17:00:34,551 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/recovered.edits/123.seqid, newMaxSeqId=123, maxSeqId=-1 2023-08-25 17:00:34,553 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1692982834553"},{"qualifier":"splitA","vlen":70,"tag":[],"timestamp":"1692982834553"},{"qualifier":"splitB","vlen":70,"tag":[],"timestamp":"1692982834553"}]},"ts":"1692982834553"} 2023-08-25 17:00:34,553 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1692982834553"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692982834553"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692982834553"}]},"ts":"1692982834553"} 2023-08-25 17:00:34,554 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1692982834553"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692982834553"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692982834553"}]},"ts":"1692982834553"} 2023-08-25 17:00:34,596 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39919] regionserver.HRegion(9158): Flush requested on 1588230740 2023-08-25 17:00:34,596 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy(69): Since none of the CFs were above the size, flushing all. 2023-08-25 17:00:34,596 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=4.82 KB heapSize=8.36 KB 2023-08-25 17:00:34,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=b47a3ed0187be817b6f5b11a8ecb6514, ASSIGN}, {pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=cb19b2ddc803809f3b21f9ccc1a6ebdc, ASSIGN}] 2023-08-25 17:00:34,607 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=cb19b2ddc803809f3b21f9ccc1a6ebdc, ASSIGN 2023-08-25 17:00:34,607 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=b47a3ed0187be817b6f5b11a8ecb6514, ASSIGN 2023-08-25 17:00:34,608 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=b47a3ed0187be817b6f5b11a8ecb6514, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,39919,1692982808794; forceNewPlan=false, retain=false 2023-08-25 17:00:34,608 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=cb19b2ddc803809f3b21f9ccc1a6ebdc, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,39919,1692982808794; forceNewPlan=false, retain=false 2023-08-25 17:00:34,612 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.61 KB at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/.tmp/info/4574f331cb8e41f8870faed487df57ef 2023-08-25 17:00:34,630 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=216 B at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/.tmp/table/de7685b0048c40a9ac45bb1da0fa21f7 2023-08-25 17:00:34,636 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/.tmp/info/4574f331cb8e41f8870faed487df57ef as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/info/4574f331cb8e41f8870faed487df57ef 2023-08-25 17:00:34,642 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/info/4574f331cb8e41f8870faed487df57ef, entries=29, sequenceid=17, filesize=8.6 K 2023-08-25 17:00:34,644 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/.tmp/table/de7685b0048c40a9ac45bb1da0fa21f7 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/table/de7685b0048c40a9ac45bb1da0fa21f7 2023-08-25 17:00:34,650 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/table/de7685b0048c40a9ac45bb1da0fa21f7, entries=4, sequenceid=17, filesize=4.8 K 2023-08-25 17:00:34,651 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~4.82 KB/4934, heapSize ~8.08 KB/8272, currentSize=0 B/0 for 1588230740 in 55ms, sequenceid=17, compaction requested=false 2023-08-25 17:00:34,652 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-08-25 17:00:34,759 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b47a3ed0187be817b6f5b11a8ecb6514, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:34,759 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cb19b2ddc803809f3b21f9ccc1a6ebdc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:34,759 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1692982834759"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1692982834759"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692982834759"}]},"ts":"1692982834759"} 2023-08-25 17:00:34,759 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1692982834759"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1692982834759"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692982834759"}]},"ts":"1692982834759"} 2023-08-25 17:00:34,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure b47a3ed0187be817b6f5b11a8ecb6514, server=jenkins-hbase4.apache.org,39919,1692982808794}] 2023-08-25 17:00:34,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=16, state=RUNNABLE; OpenRegionProcedure cb19b2ddc803809f3b21f9ccc1a6ebdc, server=jenkins-hbase4.apache.org,39919,1692982808794}] 2023-08-25 17:00:34,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:00:34,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb19b2ddc803809f3b21f9ccc1a6ebdc, NAME => 'TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.', STARTKEY => 'row0064', ENDKEY => ''} 2023-08-25 17:00:34,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:34,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:00:34,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:34,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:34,919 INFO [StoreOpener-cb19b2ddc803809f3b21f9ccc1a6ebdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:34,920 DEBUG [StoreOpener-cb19b2ddc803809f3b21f9ccc1a6ebdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info 2023-08-25 17:00:34,920 DEBUG [StoreOpener-cb19b2ddc803809f3b21f9ccc1a6ebdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info 2023-08-25 17:00:34,920 INFO [StoreOpener-cb19b2ddc803809f3b21f9ccc1a6ebdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb19b2ddc803809f3b21f9ccc1a6ebdc columnFamilyName info 2023-08-25 17:00:34,932 DEBUG [StoreOpener-cb19b2ddc803809f3b21f9ccc1a6ebdc-1] regionserver.HStore(539): loaded hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/2643fa95c12d40e7ae0e058ca0cc38f9.f28eb01c00ac51074e0973e8c7ef03b5->hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2643fa95c12d40e7ae0e058ca0cc38f9-top 2023-08-25 17:00:34,937 DEBUG [StoreOpener-cb19b2ddc803809f3b21f9ccc1a6ebdc-1] regionserver.HStore(539): loaded hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-48541388bd0a41bfaf7d789bbf1d9184 2023-08-25 17:00:34,942 DEBUG [StoreOpener-cb19b2ddc803809f3b21f9ccc1a6ebdc-1] regionserver.HStore(539): loaded hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-d416d432c6854097b6c992b0b05c8d73 2023-08-25 17:00:34,942 INFO [StoreOpener-cb19b2ddc803809f3b21f9ccc1a6ebdc-1] regionserver.HStore(310): Store=cb19b2ddc803809f3b21f9ccc1a6ebdc/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:00:34,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:34,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:34,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:34,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cb19b2ddc803809f3b21f9ccc1a6ebdc; next sequenceid=124; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=780988, jitterRate=-0.006923556327819824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 17:00:34,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:34,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc., pid=18, masterSystemTime=1692982834913 2023-08-25 17:00:34,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:34,951 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-25 17:00:34,953 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:00:34,953 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1912): cb19b2ddc803809f3b21f9ccc1a6ebdc/info is initiating minor compaction (all files) 2023-08-25 17:00:34,953 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cb19b2ddc803809f3b21f9ccc1a6ebdc/info in TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:00:34,953 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/2643fa95c12d40e7ae0e058ca0cc38f9.f28eb01c00ac51074e0973e8c7ef03b5->hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2643fa95c12d40e7ae0e058ca0cc38f9-top, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-d416d432c6854097b6c992b0b05c8d73, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-48541388bd0a41bfaf7d789bbf1d9184] into tmpdir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp, totalSize=113.3 K 2023-08-25 17:00:34,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:00:34,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:00:34,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514. 2023-08-25 17:00:34,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b47a3ed0187be817b6f5b11a8ecb6514, NAME => 'TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514.', STARTKEY => '', ENDKEY => 'row0064'} 2023-08-25 17:00:34,954 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 2643fa95c12d40e7ae0e058ca0cc38f9.f28eb01c00ac51074e0973e8c7ef03b5, keycount=34, bloomtype=ROW, size=76.0 K, encoding=NONE, compression=NONE, seqNum=87, earliestPutTs=1692982819941 2023-08-25 17:00:34,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling b47a3ed0187be817b6f5b11a8ecb6514 2023-08-25 17:00:34,955 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cb19b2ddc803809f3b21f9ccc1a6ebdc, regionState=OPEN, openSeqNum=124, regionLocation=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:34,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:00:34,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b47a3ed0187be817b6f5b11a8ecb6514 2023-08-25 17:00:34,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b47a3ed0187be817b6f5b11a8ecb6514 2023-08-25 17:00:34,955 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1692982834954"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1692982834954"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692982834954"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692982834954"}]},"ts":"1692982834954"} 2023-08-25 17:00:34,955 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-d416d432c6854097b6c992b0b05c8d73, keycount=20, bloomtype=ROW, size=25.3 K, encoding=NONE, compression=NONE, seqNum=109, earliestPutTs=1692982834163 2023-08-25 17:00:34,956 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-48541388bd0a41bfaf7d789bbf1d9184, keycount=7, bloomtype=ROW, size=11.9 K, encoding=NONE, compression=NONE, seqNum=120, earliestPutTs=1692982834190 2023-08-25 17:00:34,956 INFO [StoreOpener-b47a3ed0187be817b6f5b11a8ecb6514-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b47a3ed0187be817b6f5b11a8ecb6514 2023-08-25 17:00:34,959 DEBUG [StoreOpener-b47a3ed0187be817b6f5b11a8ecb6514-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514/info 2023-08-25 17:00:34,959 DEBUG [StoreOpener-b47a3ed0187be817b6f5b11a8ecb6514-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514/info 2023-08-25 17:00:34,959 INFO [StoreOpener-b47a3ed0187be817b6f5b11a8ecb6514-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b47a3ed0187be817b6f5b11a8ecb6514 columnFamilyName info 2023-08-25 17:00:34,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=16 2023-08-25 17:00:34,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=16, state=SUCCESS; OpenRegionProcedure cb19b2ddc803809f3b21f9ccc1a6ebdc, server=jenkins-hbase4.apache.org,39919,1692982808794 in 195 msec 2023-08-25 17:00:34,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=cb19b2ddc803809f3b21f9ccc1a6ebdc, ASSIGN in 354 msec 2023-08-25 17:00:34,974 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] throttle.PressureAwareThroughputController(145): cb19b2ddc803809f3b21f9ccc1a6ebdc#info#compaction#26 average throughput is 16.54 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-25 17:00:34,979 DEBUG [StoreOpener-b47a3ed0187be817b6f5b11a8ecb6514-1] regionserver.HStore(539): loaded hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514/info/2643fa95c12d40e7ae0e058ca0cc38f9.f28eb01c00ac51074e0973e8c7ef03b5->hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2643fa95c12d40e7ae0e058ca0cc38f9-bottom 2023-08-25 17:00:34,981 INFO [StoreOpener-b47a3ed0187be817b6f5b11a8ecb6514-1] regionserver.HStore(310): Store=b47a3ed0187be817b6f5b11a8ecb6514/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:00:34,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514 2023-08-25 17:00:34,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514 2023-08-25 17:00:34,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b47a3ed0187be817b6f5b11a8ecb6514 2023-08-25 17:00:35,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b47a3ed0187be817b6f5b11a8ecb6514; next sequenceid=124; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=804437, jitterRate=0.022894740104675293}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 17:00:35,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b47a3ed0187be817b6f5b11a8ecb6514: 2023-08-25 17:00:35,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514., pid=17, masterSystemTime=1692982834913 2023-08-25 17:00:35,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-08-25 17:00:35,003 DEBUG [RS:0;jenkins-hbase4:39919-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-08-25 17:00:35,004 INFO [RS:0;jenkins-hbase4:39919-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514. 2023-08-25 17:00:35,004 DEBUG [RS:0;jenkins-hbase4:39919-longCompactions-0] regionserver.HStore(1912): b47a3ed0187be817b6f5b11a8ecb6514/info is initiating minor compaction (all files) 2023-08-25 17:00:35,004 INFO [RS:0;jenkins-hbase4:39919-longCompactions-0] regionserver.HRegion(2259): Starting compaction of b47a3ed0187be817b6f5b11a8ecb6514/info in TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514. 2023-08-25 17:00:35,004 INFO [RS:0;jenkins-hbase4:39919-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514/info/2643fa95c12d40e7ae0e058ca0cc38f9.f28eb01c00ac51074e0973e8c7ef03b5->hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2643fa95c12d40e7ae0e058ca0cc38f9-bottom] into tmpdir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514/.tmp, totalSize=76.0 K 2023-08-25 17:00:35,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514. 2023-08-25 17:00:35,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514. 2023-08-25 17:00:35,005 DEBUG [RS:0;jenkins-hbase4:39919-longCompactions-0] compactions.Compactor(207): Compacting 2643fa95c12d40e7ae0e058ca0cc38f9.f28eb01c00ac51074e0973e8c7ef03b5, keycount=34, bloomtype=ROW, size=76.0 K, encoding=NONE, compression=NONE, seqNum=86, earliestPutTs=1692982819941 2023-08-25 17:00:35,006 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/31182683d6314ba3a9e640bcfad6e8ed as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/31182683d6314ba3a9e640bcfad6e8ed 2023-08-25 17:00:35,006 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b47a3ed0187be817b6f5b11a8ecb6514, regionState=OPEN, openSeqNum=124, regionLocation=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:35,006 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1692982835006"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1692982835006"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692982835006"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692982835006"}]},"ts":"1692982835006"} 2023-08-25 17:00:35,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-08-25 17:00:35,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure b47a3ed0187be817b6f5b11a8ecb6514, server=jenkins-hbase4.apache.org,39919,1692982808794 in 247 msec 2023-08-25 17:00:35,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=12 2023-08-25 17:00:35,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=b47a3ed0187be817b6f5b11a8ecb6514, ASSIGN in 405 msec 2023-08-25 17:00:35,016 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cb19b2ddc803809f3b21f9ccc1a6ebdc/info of cb19b2ddc803809f3b21f9ccc1a6ebdc into 31182683d6314ba3a9e640bcfad6e8ed(size=39.0 K), total size for store is 39.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-25 17:00:35,016 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:35,016 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc., storeName=cb19b2ddc803809f3b21f9ccc1a6ebdc/info, priority=13, startTime=1692982834951; duration=0sec 2023-08-25 17:00:35,016 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:35,016 INFO [RS:0;jenkins-hbase4:39919-longCompactions-0] throttle.PressureAwareThroughputController(145): b47a3ed0187be817b6f5b11a8ecb6514#info#compaction#27 average throughput is 21.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-25 17:00:35,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=f28eb01c00ac51074e0973e8c7ef03b5, daughterA=b47a3ed0187be817b6f5b11a8ecb6514, daughterB=cb19b2ddc803809f3b21f9ccc1a6ebdc in 773 msec 2023-08-25 17:00:35,032 DEBUG [RS:0;jenkins-hbase4:39919-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514/.tmp/info/637d1ab434c44098ac09818860445a68 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514/info/637d1ab434c44098ac09818860445a68 2023-08-25 17:00:35,039 INFO [RS:0;jenkins-hbase4:39919-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in b47a3ed0187be817b6f5b11a8ecb6514/info of b47a3ed0187be817b6f5b11a8ecb6514 into 637d1ab434c44098ac09818860445a68(size=69.7 K), total size for store is 69.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-25 17:00:35,039 DEBUG [RS:0;jenkins-hbase4:39919-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for b47a3ed0187be817b6f5b11a8ecb6514: 2023-08-25 17:00:35,039 INFO [RS:0;jenkins-hbase4:39919-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514., storeName=b47a3ed0187be817b6f5b11a8ecb6514/info, priority=15, startTime=1692982835002; duration=0sec 2023-08-25 17:00:35,039 DEBUG [RS:0;jenkins-hbase4:39919-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:36,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:34018 deadline: 1692982846200, exception=org.apache.hadoop.hbase.NotServingRegionException: TestLogRolling-testLogRolling,,1692982809927.f28eb01c00ac51074e0973e8c7ef03b5. is not online on jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:39,998 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-25 17:00:46,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:46,265 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing cb19b2ddc803809f3b21f9ccc1a6ebdc 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-25 17:00:46,277 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=135 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/166f41fba7b64c5b99cc6b404044b2d0 2023-08-25 17:00:46,283 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/166f41fba7b64c5b99cc6b404044b2d0 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/166f41fba7b64c5b99cc6b404044b2d0 2023-08-25 17:00:46,289 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/166f41fba7b64c5b99cc6b404044b2d0, entries=8, sequenceid=135, filesize=13.0 K 2023-08-25 17:00:46,290 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=20.53 KB/21020 for cb19b2ddc803809f3b21f9ccc1a6ebdc in 25ms, sequenceid=135, compaction requested=false 2023-08-25 17:00:46,290 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:46,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:46,291 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing cb19b2ddc803809f3b21f9ccc1a6ebdc 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-25 17:00:46,304 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/c80b19a72a22403bba4e93f0273fdffa 2023-08-25 17:00:46,310 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/c80b19a72a22403bba4e93f0273fdffa as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/c80b19a72a22403bba4e93f0273fdffa 2023-08-25 17:00:46,315 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/c80b19a72a22403bba4e93f0273fdffa, entries=22, sequenceid=160, filesize=27.4 K 2023-08-25 17:00:46,316 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for cb19b2ddc803809f3b21f9ccc1a6ebdc in 25ms, sequenceid=160, compaction requested=true 2023-08-25 17:00:46,316 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:46,316 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:46,316 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-25 17:00:46,317 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 81224 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-25 17:00:46,317 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1912): cb19b2ddc803809f3b21f9ccc1a6ebdc/info is initiating minor compaction (all files) 2023-08-25 17:00:46,317 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cb19b2ddc803809f3b21f9ccc1a6ebdc/info in TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:00:46,317 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/31182683d6314ba3a9e640bcfad6e8ed, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/166f41fba7b64c5b99cc6b404044b2d0, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/c80b19a72a22403bba4e93f0273fdffa] into tmpdir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp, totalSize=79.3 K 2023-08-25 17:00:46,318 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 31182683d6314ba3a9e640bcfad6e8ed, keycount=33, bloomtype=ROW, size=39.0 K, encoding=NONE, compression=NONE, seqNum=120, earliestPutTs=1692982832155 2023-08-25 17:00:46,318 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 166f41fba7b64c5b99cc6b404044b2d0, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=135, earliestPutTs=1692982846257 2023-08-25 17:00:46,319 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting c80b19a72a22403bba4e93f0273fdffa, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=160, earliestPutTs=1692982846265 2023-08-25 17:00:46,330 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] throttle.PressureAwareThroughputController(145): cb19b2ddc803809f3b21f9ccc1a6ebdc#info#compaction#30 average throughput is 31.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-25 17:00:46,351 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/31774ed2baac485eaf15f34bdf2fa027 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/31774ed2baac485eaf15f34bdf2fa027 2023-08-25 17:00:46,357 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cb19b2ddc803809f3b21f9ccc1a6ebdc/info of cb19b2ddc803809f3b21f9ccc1a6ebdc into 31774ed2baac485eaf15f34bdf2fa027(size=70.0 K), total size for store is 70.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-25 17:00:46,357 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:46,357 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc., storeName=cb19b2ddc803809f3b21f9ccc1a6ebdc/info, priority=13, startTime=1692982846316; duration=0sec 2023-08-25 17:00:46,357 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:48,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:48,302 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing cb19b2ddc803809f3b21f9ccc1a6ebdc 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-25 17:00:48,315 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=172 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/c16908589b9241048e82abfd0913c350 2023-08-25 17:00:48,323 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/c16908589b9241048e82abfd0913c350 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/c16908589b9241048e82abfd0913c350 2023-08-25 17:00:48,329 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/c16908589b9241048e82abfd0913c350, entries=8, sequenceid=172, filesize=13.0 K 2023-08-25 17:00:48,330 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for cb19b2ddc803809f3b21f9ccc1a6ebdc in 28ms, sequenceid=172, compaction requested=false 2023-08-25 17:00:48,330 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:48,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:48,331 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing cb19b2ddc803809f3b21f9ccc1a6ebdc 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-25 17:00:48,344 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=197 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/8e045a27bcf246faaece41a7ae96492d 2023-08-25 17:00:48,349 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/8e045a27bcf246faaece41a7ae96492d as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/8e045a27bcf246faaece41a7ae96492d 2023-08-25 17:00:48,354 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/8e045a27bcf246faaece41a7ae96492d, entries=22, sequenceid=197, filesize=27.4 K 2023-08-25 17:00:48,355 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=4.11 KB/4204 for cb19b2ddc803809f3b21f9ccc1a6ebdc in 24ms, sequenceid=197, compaction requested=true 2023-08-25 17:00:48,355 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:48,355 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:48,355 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-25 17:00:48,356 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 112988 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-25 17:00:48,357 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1912): cb19b2ddc803809f3b21f9ccc1a6ebdc/info is initiating minor compaction (all files) 2023-08-25 17:00:48,357 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cb19b2ddc803809f3b21f9ccc1a6ebdc/info in TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:00:48,357 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/31774ed2baac485eaf15f34bdf2fa027, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/c16908589b9241048e82abfd0913c350, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/8e045a27bcf246faaece41a7ae96492d] into tmpdir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp, totalSize=110.3 K 2023-08-25 17:00:48,357 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 31774ed2baac485eaf15f34bdf2fa027, keycount=63, bloomtype=ROW, size=70.0 K, encoding=NONE, compression=NONE, seqNum=160, earliestPutTs=1692982832155 2023-08-25 17:00:48,357 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting c16908589b9241048e82abfd0913c350, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=172, earliestPutTs=1692982846292 2023-08-25 17:00:48,358 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 8e045a27bcf246faaece41a7ae96492d, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=197, earliestPutTs=1692982848302 2023-08-25 17:00:48,370 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] throttle.PressureAwareThroughputController(145): cb19b2ddc803809f3b21f9ccc1a6ebdc#info#compaction#33 average throughput is 46.61 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-25 17:00:48,384 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/37d200bf1f1e4a2a86c50ae124dbc1d6 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/37d200bf1f1e4a2a86c50ae124dbc1d6 2023-08-25 17:00:48,391 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cb19b2ddc803809f3b21f9ccc1a6ebdc/info of cb19b2ddc803809f3b21f9ccc1a6ebdc into 37d200bf1f1e4a2a86c50ae124dbc1d6(size=101.0 K), total size for store is 101.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-25 17:00:48,391 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:48,391 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc., storeName=cb19b2ddc803809f3b21f9ccc1a6ebdc/info, priority=13, startTime=1692982848355; duration=0sec 2023-08-25 17:00:48,391 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:50,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:50,342 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing cb19b2ddc803809f3b21f9ccc1a6ebdc 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-25 17:00:50,354 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=209 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/d4d57bd0be9a4309b66ecccc9de3caa5 2023-08-25 17:00:50,361 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/d4d57bd0be9a4309b66ecccc9de3caa5 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/d4d57bd0be9a4309b66ecccc9de3caa5 2023-08-25 17:00:50,366 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/d4d57bd0be9a4309b66ecccc9de3caa5, entries=8, sequenceid=209, filesize=13.0 K 2023-08-25 17:00:50,367 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=19.50 KB/19969 for cb19b2ddc803809f3b21f9ccc1a6ebdc in 25ms, sequenceid=209, compaction requested=false 2023-08-25 17:00:50,367 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:50,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:50,368 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing cb19b2ddc803809f3b21f9ccc1a6ebdc 1/1 column families, dataSize=20.53 KB heapSize=22.28 KB 2023-08-25 17:00:50,378 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=20.53 KB at sequenceid=232 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/a38b6197281e413fa6d780867f893170 2023-08-25 17:00:50,384 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/a38b6197281e413fa6d780867f893170 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/a38b6197281e413fa6d780867f893170 2023-08-25 17:00:50,388 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/a38b6197281e413fa6d780867f893170, entries=20, sequenceid=232, filesize=25.3 K 2023-08-25 17:00:50,389 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~20.53 KB/21020, heapSize ~22.27 KB/22800, currentSize=8.21 KB/8408 for cb19b2ddc803809f3b21f9ccc1a6ebdc in 21ms, sequenceid=232, compaction requested=true 2023-08-25 17:00:50,389 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:50,389 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:50,389 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-25 17:00:50,390 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 142647 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-25 17:00:50,390 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1912): cb19b2ddc803809f3b21f9ccc1a6ebdc/info is initiating minor compaction (all files) 2023-08-25 17:00:50,390 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cb19b2ddc803809f3b21f9ccc1a6ebdc/info in TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:00:50,391 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/37d200bf1f1e4a2a86c50ae124dbc1d6, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/d4d57bd0be9a4309b66ecccc9de3caa5, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/a38b6197281e413fa6d780867f893170] into tmpdir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp, totalSize=139.3 K 2023-08-25 17:00:50,391 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 37d200bf1f1e4a2a86c50ae124dbc1d6, keycount=93, bloomtype=ROW, size=101.0 K, encoding=NONE, compression=NONE, seqNum=197, earliestPutTs=1692982832155 2023-08-25 17:00:50,391 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting d4d57bd0be9a4309b66ecccc9de3caa5, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=209, earliestPutTs=1692982848331 2023-08-25 17:00:50,392 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting a38b6197281e413fa6d780867f893170, keycount=20, bloomtype=ROW, size=25.3 K, encoding=NONE, compression=NONE, seqNum=232, earliestPutTs=1692982850343 2023-08-25 17:00:50,402 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] throttle.PressureAwareThroughputController(145): cb19b2ddc803809f3b21f9ccc1a6ebdc#info#compaction#36 average throughput is 60.64 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-25 17:00:50,413 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/47b9751f8b4c441697d00b25bd1dc8ef as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/47b9751f8b4c441697d00b25bd1dc8ef 2023-08-25 17:00:50,418 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cb19b2ddc803809f3b21f9ccc1a6ebdc/info of cb19b2ddc803809f3b21f9ccc1a6ebdc into 47b9751f8b4c441697d00b25bd1dc8ef(size=130.0 K), total size for store is 130.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-25 17:00:50,418 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:50,418 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc., storeName=cb19b2ddc803809f3b21f9ccc1a6ebdc/info, priority=13, startTime=1692982850389; duration=0sec 2023-08-25 17:00:50,418 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:52,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:52,380 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing cb19b2ddc803809f3b21f9ccc1a6ebdc 1/1 column families, dataSize=9.24 KB heapSize=10.16 KB 2023-08-25 17:00:52,390 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=9.24 KB at sequenceid=245 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/1bfc4f9220994133af6cfd2e258b8af4 2023-08-25 17:00:52,396 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/1bfc4f9220994133af6cfd2e258b8af4 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/1bfc4f9220994133af6cfd2e258b8af4 2023-08-25 17:00:52,402 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/1bfc4f9220994133af6cfd2e258b8af4, entries=9, sequenceid=245, filesize=14.0 K 2023-08-25 17:00:52,403 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~9.24 KB/9459, heapSize ~10.15 KB/10392, currentSize=18.47 KB/18918 for cb19b2ddc803809f3b21f9ccc1a6ebdc in 24ms, sequenceid=245, compaction requested=false 2023-08-25 17:00:52,403 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:52,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:00:52,404 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing cb19b2ddc803809f3b21f9ccc1a6ebdc 1/1 column families, dataSize=19.50 KB heapSize=21.18 KB 2023-08-25 17:00:52,416 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=19.50 KB at sequenceid=267 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/93157f24a29f4e87b322f032df9de4d8 2023-08-25 17:00:52,419 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=cb19b2ddc803809f3b21f9ccc1a6ebdc, server=jenkins-hbase4.apache.org,39919,1692982808794 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-25 17:00:52,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:34018 deadline: 1692982862418, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=cb19b2ddc803809f3b21f9ccc1a6ebdc, server=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:00:52,423 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/93157f24a29f4e87b322f032df9de4d8 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/93157f24a29f4e87b322f032df9de4d8 2023-08-25 17:00:52,427 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/93157f24a29f4e87b322f032df9de4d8, entries=19, sequenceid=267, filesize=24.3 K 2023-08-25 17:00:52,428 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~19.50 KB/19969, heapSize ~21.16 KB/21672, currentSize=10.26 KB/10510 for cb19b2ddc803809f3b21f9ccc1a6ebdc in 24ms, sequenceid=267, compaction requested=true 2023-08-25 17:00:52,428 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:52,428 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:00:52,428 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-25 17:00:52,430 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 172379 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-25 17:00:52,430 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1912): cb19b2ddc803809f3b21f9ccc1a6ebdc/info is initiating minor compaction (all files) 2023-08-25 17:00:52,430 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cb19b2ddc803809f3b21f9ccc1a6ebdc/info in TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:00:52,430 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/47b9751f8b4c441697d00b25bd1dc8ef, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/1bfc4f9220994133af6cfd2e258b8af4, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/93157f24a29f4e87b322f032df9de4d8] into tmpdir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp, totalSize=168.3 K 2023-08-25 17:00:52,430 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 47b9751f8b4c441697d00b25bd1dc8ef, keycount=121, bloomtype=ROW, size=130.0 K, encoding=NONE, compression=NONE, seqNum=232, earliestPutTs=1692982832155 2023-08-25 17:00:52,431 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 1bfc4f9220994133af6cfd2e258b8af4, keycount=9, bloomtype=ROW, size=14.0 K, encoding=NONE, compression=NONE, seqNum=245, earliestPutTs=1692982850369 2023-08-25 17:00:52,431 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 93157f24a29f4e87b322f032df9de4d8, keycount=19, bloomtype=ROW, size=24.3 K, encoding=NONE, compression=NONE, seqNum=267, earliestPutTs=1692982852380 2023-08-25 17:00:52,442 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] throttle.PressureAwareThroughputController(145): cb19b2ddc803809f3b21f9ccc1a6ebdc#info#compaction#39 average throughput is 74.67 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-25 17:00:52,454 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/cca3cfd8081348a3903efa0a7145a280 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/cca3cfd8081348a3903efa0a7145a280 2023-08-25 17:00:52,460 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cb19b2ddc803809f3b21f9ccc1a6ebdc/info of cb19b2ddc803809f3b21f9ccc1a6ebdc into cca3cfd8081348a3903efa0a7145a280(size=159.0 K), total size for store is 159.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-25 17:00:52,460 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:00:52,460 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc., storeName=cb19b2ddc803809f3b21f9ccc1a6ebdc/info, priority=13, startTime=1692982852428; duration=0sec 2023-08-25 17:00:52,460 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:01:02,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:01:02,497 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing cb19b2ddc803809f3b21f9ccc1a6ebdc 1/1 column families, dataSize=11.29 KB heapSize=12.37 KB 2023-08-25 17:01:02,509 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=11.29 KB at sequenceid=282 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/a4f3ef90600f4cc89efbbde1efe7293e 2023-08-25 17:01:02,515 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/a4f3ef90600f4cc89efbbde1efe7293e as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/a4f3ef90600f4cc89efbbde1efe7293e 2023-08-25 17:01:02,519 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/a4f3ef90600f4cc89efbbde1efe7293e, entries=11, sequenceid=282, filesize=16.1 K 2023-08-25 17:01:02,520 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~11.29 KB/11561, heapSize ~12.35 KB/12648, currentSize=1.03 KB/1051 for cb19b2ddc803809f3b21f9ccc1a6ebdc in 23ms, sequenceid=282, compaction requested=false 2023-08-25 17:01:02,520 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:01:04,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:01:04,506 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing cb19b2ddc803809f3b21f9ccc1a6ebdc 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-25 17:01:04,522 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=293 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/3ccb12c2dc2446d082f4aebd672c5566 2023-08-25 17:01:04,529 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=cb19b2ddc803809f3b21f9ccc1a6ebdc, server=jenkins-hbase4.apache.org,39919,1692982808794 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-25 17:01:04,529 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/3ccb12c2dc2446d082f4aebd672c5566 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/3ccb12c2dc2446d082f4aebd672c5566 2023-08-25 17:01:04,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] ipc.CallRunner(144): callId: 269 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:34018 deadline: 1692982874529, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=cb19b2ddc803809f3b21f9ccc1a6ebdc, server=jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:01:04,534 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/3ccb12c2dc2446d082f4aebd672c5566, entries=8, sequenceid=293, filesize=13.0 K 2023-08-25 17:01:04,535 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for cb19b2ddc803809f3b21f9ccc1a6ebdc in 29ms, sequenceid=293, compaction requested=true 2023-08-25 17:01:04,535 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:01:04,535 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:01:04,535 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-25 17:01:04,536 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 192563 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-25 17:01:04,536 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1912): cb19b2ddc803809f3b21f9ccc1a6ebdc/info is initiating minor compaction (all files) 2023-08-25 17:01:04,536 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cb19b2ddc803809f3b21f9ccc1a6ebdc/info in TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:01:04,537 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/cca3cfd8081348a3903efa0a7145a280, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/a4f3ef90600f4cc89efbbde1efe7293e, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/3ccb12c2dc2446d082f4aebd672c5566] into tmpdir=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp, totalSize=188.0 K 2023-08-25 17:01:04,537 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting cca3cfd8081348a3903efa0a7145a280, keycount=149, bloomtype=ROW, size=159.0 K, encoding=NONE, compression=NONE, seqNum=267, earliestPutTs=1692982832155 2023-08-25 17:01:04,537 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting a4f3ef90600f4cc89efbbde1efe7293e, keycount=11, bloomtype=ROW, size=16.1 K, encoding=NONE, compression=NONE, seqNum=282, earliestPutTs=1692982852404 2023-08-25 17:01:04,538 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] compactions.Compactor(207): Compacting 3ccb12c2dc2446d082f4aebd672c5566, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=293, earliestPutTs=1692982862498 2023-08-25 17:01:04,555 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] throttle.PressureAwareThroughputController(145): cb19b2ddc803809f3b21f9ccc1a6ebdc#info#compaction#42 average throughput is 56.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-25 17:01:04,574 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/61cb18b67fc14a79b1f06328a4a5a9dc as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/61cb18b67fc14a79b1f06328a4a5a9dc 2023-08-25 17:01:04,582 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cb19b2ddc803809f3b21f9ccc1a6ebdc/info of cb19b2ddc803809f3b21f9ccc1a6ebdc into 61cb18b67fc14a79b1f06328a4a5a9dc(size=178.7 K), total size for store is 178.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-25 17:01:04,582 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:01:04,582 INFO [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc., storeName=cb19b2ddc803809f3b21f9ccc1a6ebdc/info, priority=13, startTime=1692982864535; duration=0sec 2023-08-25 17:01:04,582 DEBUG [RS:0;jenkins-hbase4:39919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-25 17:01:14,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39919] regionserver.HRegion(9158): Flush requested on cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:01:14,613 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing cb19b2ddc803809f3b21f9ccc1a6ebdc 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-25 17:01:14,624 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=319 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/882f00f72d8d46528f26fc06986d5243 2023-08-25 17:01:14,630 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/882f00f72d8d46528f26fc06986d5243 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/882f00f72d8d46528f26fc06986d5243 2023-08-25 17:01:14,635 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/882f00f72d8d46528f26fc06986d5243, entries=22, sequenceid=319, filesize=27.4 K 2023-08-25 17:01:14,635 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=3.08 KB/3153 for cb19b2ddc803809f3b21f9ccc1a6ebdc in 22ms, sequenceid=319, compaction requested=false 2023-08-25 17:01:14,635 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:01:16,618 INFO [Listener at localhost/46709] wal.AbstractTestLogRolling(188): after writing there are 0 log files 2023-08-25 17:01:16,635 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39639,DS-676c6434-5e7f-4d32-804d-5cc030102e4a,DISK] 2023-08-25 17:01:16,635 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37311,DS-0b5f20e2-3ce2-4940-ba36-aee05221b5aa,DISK] 2023-08-25 17:01:16,638 INFO [Listener at localhost/46709] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794/jenkins-hbase4.apache.org%2C39919%2C1692982808794.1692982809170 with entries=308, filesize=300.35 KB; new WAL /user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794/jenkins-hbase4.apache.org%2C39919%2C1692982808794.1692982876618 2023-08-25 17:01:16,638 DEBUG [Listener at localhost/46709] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39639,DS-676c6434-5e7f-4d32-804d-5cc030102e4a,DISK], DatanodeInfoWithStorage[127.0.0.1:37311,DS-0b5f20e2-3ce2-4940-ba36-aee05221b5aa,DISK]] 2023-08-25 17:01:16,638 DEBUG [Listener at localhost/46709] wal.AbstractFSWAL(716): hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794/jenkins-hbase4.apache.org%2C39919%2C1692982808794.1692982809170 is not closed yet, will try archiving it next time 2023-08-25 17:01:16,643 INFO [Listener at localhost/46709] regionserver.HRegion(2745): Flushing cb19b2ddc803809f3b21f9ccc1a6ebdc 1/1 column families, dataSize=3.08 KB heapSize=3.55 KB 2023-08-25 17:01:16,651 INFO [Listener at localhost/46709] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.08 KB at sequenceid=325 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/d0ccac5294294e829b69035ff471b81f 2023-08-25 17:01:16,656 DEBUG [Listener at localhost/46709] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/.tmp/info/d0ccac5294294e829b69035ff471b81f as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/d0ccac5294294e829b69035ff471b81f 2023-08-25 17:01:16,662 INFO [Listener at localhost/46709] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/d0ccac5294294e829b69035ff471b81f, entries=3, sequenceid=325, filesize=7.8 K 2023-08-25 17:01:16,662 INFO [Listener at localhost/46709] regionserver.HRegion(2948): Finished flush of dataSize ~3.08 KB/3153, heapSize ~3.54 KB/3624, currentSize=0 B/0 for cb19b2ddc803809f3b21f9ccc1a6ebdc in 19ms, sequenceid=325, compaction requested=true 2023-08-25 17:01:16,663 DEBUG [Listener at localhost/46709] regionserver.HRegion(2446): Flush status journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:01:16,663 DEBUG [Listener at localhost/46709] regionserver.HRegion(2446): Flush status journal for b47a3ed0187be817b6f5b11a8ecb6514: 2023-08-25 17:01:16,663 INFO [Listener at localhost/46709] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.26 KB heapSize=4.19 KB 2023-08-25 17:01:16,679 INFO [Listener at localhost/46709] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.26 KB at sequenceid=24 (bloomFilter=false), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/.tmp/info/e6e8f1d773ee4c47bbd1d7d64f8e67a9 2023-08-25 17:01:16,685 DEBUG [Listener at localhost/46709] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/.tmp/info/e6e8f1d773ee4c47bbd1d7d64f8e67a9 as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/info/e6e8f1d773ee4c47bbd1d7d64f8e67a9 2023-08-25 17:01:16,690 INFO [Listener at localhost/46709] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/info/e6e8f1d773ee4c47bbd1d7d64f8e67a9, entries=16, sequenceid=24, filesize=7.0 K 2023-08-25 17:01:16,690 INFO [Listener at localhost/46709] regionserver.HRegion(2948): Finished flush of dataSize ~2.26 KB/2312, heapSize ~3.67 KB/3760, currentSize=0 B/0 for 1588230740 in 27ms, sequenceid=24, compaction requested=false 2023-08-25 17:01:16,690 DEBUG [Listener at localhost/46709] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-08-25 17:01:16,691 INFO [Listener at localhost/46709] regionserver.HRegion(2745): Flushing 469f30df4f0d73a5b5ab554fabb8011c 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-25 17:01:16,701 INFO [Listener at localhost/46709] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c/.tmp/info/e1de7b32e5a047bd805072b7e3b69adc 2023-08-25 17:01:16,706 DEBUG [Listener at localhost/46709] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c/.tmp/info/e1de7b32e5a047bd805072b7e3b69adc as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c/info/e1de7b32e5a047bd805072b7e3b69adc 2023-08-25 17:01:16,711 INFO [Listener at localhost/46709] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c/info/e1de7b32e5a047bd805072b7e3b69adc, entries=2, sequenceid=6, filesize=4.8 K 2023-08-25 17:01:16,712 INFO [Listener at localhost/46709] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 469f30df4f0d73a5b5ab554fabb8011c in 21ms, sequenceid=6, compaction requested=false 2023-08-25 17:01:16,713 DEBUG [Listener at localhost/46709] regionserver.HRegion(2446): Flush status journal for 469f30df4f0d73a5b5ab554fabb8011c: 2023-08-25 17:01:16,731 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37311,DS-0b5f20e2-3ce2-4940-ba36-aee05221b5aa,DISK] 2023-08-25 17:01:16,732 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39639,DS-676c6434-5e7f-4d32-804d-5cc030102e4a,DISK] 2023-08-25 17:01:16,733 INFO [Listener at localhost/46709] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794/jenkins-hbase4.apache.org%2C39919%2C1692982808794.1692982876618 with entries=4, filesize=1.22 KB; new WAL /user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794/jenkins-hbase4.apache.org%2C39919%2C1692982808794.1692982876713 2023-08-25 17:01:16,733 DEBUG [Listener at localhost/46709] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37311,DS-0b5f20e2-3ce2-4940-ba36-aee05221b5aa,DISK], DatanodeInfoWithStorage[127.0.0.1:39639,DS-676c6434-5e7f-4d32-804d-5cc030102e4a,DISK]] 2023-08-25 17:01:16,734 DEBUG [Listener at localhost/46709] wal.AbstractFSWAL(716): hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794/jenkins-hbase4.apache.org%2C39919%2C1692982808794.1692982876618 is not closed yet, will try archiving it next time 2023-08-25 17:01:16,734 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794/jenkins-hbase4.apache.org%2C39919%2C1692982808794.1692982809170 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/oldWALs/jenkins-hbase4.apache.org%2C39919%2C1692982808794.1692982809170 2023-08-25 17:01:16,734 INFO [Listener at localhost/46709] hbase.Waiter(180): Waiting up to [5,000] milli-secs(wait.for.ratio=[1]) 2023-08-25 17:01:16,736 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/WALs/jenkins-hbase4.apache.org,39919,1692982808794/jenkins-hbase4.apache.org%2C39919%2C1692982808794.1692982876618 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/oldWALs/jenkins-hbase4.apache.org%2C39919%2C1692982808794.1692982876618 2023-08-25 17:01:16,835 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-25 17:01:16,835 INFO [Listener at localhost/46709] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-25 17:01:16,835 DEBUG [Listener at localhost/46709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14ca54dd to 127.0.0.1:59206 2023-08-25 17:01:16,835 DEBUG [Listener at localhost/46709] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:01:16,835 DEBUG [Listener at localhost/46709] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-25 17:01:16,835 DEBUG [Listener at localhost/46709] util.JVMClusterUtil(257): Found active master hash=1800092819, stopped=false 2023-08-25 17:01:16,835 INFO [Listener at localhost/46709] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44471,1692982808750 2023-08-25 17:01:16,837 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-25 17:01:16,837 INFO [Listener at localhost/46709] procedure2.ProcedureExecutor(629): Stopping 2023-08-25 17:01:16,837 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:16,837 DEBUG [Listener at localhost/46709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f562296 to 127.0.0.1:59206 2023-08-25 17:01:16,838 DEBUG [Listener at localhost/46709] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:01:16,837 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-25 17:01:16,838 INFO [Listener at localhost/46709] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39919,1692982808794' ***** 2023-08-25 17:01:16,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 17:01:16,838 INFO [Listener at localhost/46709] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-25 17:01:16,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 17:01:16,839 INFO [RS:0;jenkins-hbase4:39919] regionserver.HeapMemoryManager(220): Stopping 2023-08-25 17:01:16,839 INFO [RS:0;jenkins-hbase4:39919] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-25 17:01:16,839 INFO [RS:0;jenkins-hbase4:39919] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-25 17:01:16,839 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-25 17:01:16,839 INFO [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(3305): Received CLOSE for cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:01:16,839 INFO [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(3305): Received CLOSE for b47a3ed0187be817b6f5b11a8ecb6514 2023-08-25 17:01:16,839 INFO [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(3305): Received CLOSE for 469f30df4f0d73a5b5ab554fabb8011c 2023-08-25 17:01:16,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cb19b2ddc803809f3b21f9ccc1a6ebdc, disabling compactions & flushes 2023-08-25 17:01:16,839 INFO [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:01:16,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:01:16,840 DEBUG [RS:0;jenkins-hbase4:39919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a278da9 to 127.0.0.1:59206 2023-08-25 17:01:16,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:01:16,840 DEBUG [RS:0;jenkins-hbase4:39919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:01:16,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. after waiting 0 ms 2023-08-25 17:01:16,840 INFO [RS:0;jenkins-hbase4:39919] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-25 17:01:16,840 INFO [RS:0;jenkins-hbase4:39919] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-25 17:01:16,840 INFO [RS:0;jenkins-hbase4:39919] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-25 17:01:16,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:01:16,840 INFO [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-25 17:01:16,840 INFO [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-08-25 17:01:16,840 DEBUG [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(1478): Online Regions={cb19b2ddc803809f3b21f9ccc1a6ebdc=TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc., b47a3ed0187be817b6f5b11a8ecb6514=TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514., 1588230740=hbase:meta,,1.1588230740, 469f30df4f0d73a5b5ab554fabb8011c=hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c.} 2023-08-25 17:01:16,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-25 17:01:16,842 DEBUG [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(1504): Waiting on 1588230740, 469f30df4f0d73a5b5ab554fabb8011c, b47a3ed0187be817b6f5b11a8ecb6514, cb19b2ddc803809f3b21f9ccc1a6ebdc 2023-08-25 17:01:16,843 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-25 17:01:16,844 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-25 17:01:16,844 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-25 17:01:16,845 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-25 17:01:16,856 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/2643fa95c12d40e7ae0e058ca0cc38f9.f28eb01c00ac51074e0973e8c7ef03b5->hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2643fa95c12d40e7ae0e058ca0cc38f9-top, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-d416d432c6854097b6c992b0b05c8d73, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/31182683d6314ba3a9e640bcfad6e8ed, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-48541388bd0a41bfaf7d789bbf1d9184, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/166f41fba7b64c5b99cc6b404044b2d0, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/31774ed2baac485eaf15f34bdf2fa027, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/c80b19a72a22403bba4e93f0273fdffa, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/c16908589b9241048e82abfd0913c350, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/37d200bf1f1e4a2a86c50ae124dbc1d6, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/8e045a27bcf246faaece41a7ae96492d, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/d4d57bd0be9a4309b66ecccc9de3caa5, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/47b9751f8b4c441697d00b25bd1dc8ef, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/a38b6197281e413fa6d780867f893170, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/1bfc4f9220994133af6cfd2e258b8af4, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/cca3cfd8081348a3903efa0a7145a280, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/93157f24a29f4e87b322f032df9de4d8, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/a4f3ef90600f4cc89efbbde1efe7293e, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/3ccb12c2dc2446d082f4aebd672c5566] to archive 2023-08-25 17:01:16,857 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-25 17:01:16,859 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/2643fa95c12d40e7ae0e058ca0cc38f9.f28eb01c00ac51074e0973e8c7ef03b5 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/2643fa95c12d40e7ae0e058ca0cc38f9.f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:01:16,860 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/meta/1588230740/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-08-25 17:01:16,861 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-25 17:01:16,861 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-25 17:01:16,861 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-25 17:01:16,861 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-25 17:01:16,862 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-d416d432c6854097b6c992b0b05c8d73 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-d416d432c6854097b6c992b0b05c8d73 2023-08-25 17:01:16,863 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/31182683d6314ba3a9e640bcfad6e8ed to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/31182683d6314ba3a9e640bcfad6e8ed 2023-08-25 17:01:16,864 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-48541388bd0a41bfaf7d789bbf1d9184 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/TestLogRolling-testLogRolling=f28eb01c00ac51074e0973e8c7ef03b5-48541388bd0a41bfaf7d789bbf1d9184 2023-08-25 17:01:16,866 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/166f41fba7b64c5b99cc6b404044b2d0 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/166f41fba7b64c5b99cc6b404044b2d0 2023-08-25 17:01:16,867 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/31774ed2baac485eaf15f34bdf2fa027 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/31774ed2baac485eaf15f34bdf2fa027 2023-08-25 17:01:16,868 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/c80b19a72a22403bba4e93f0273fdffa to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/c80b19a72a22403bba4e93f0273fdffa 2023-08-25 17:01:16,869 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/c16908589b9241048e82abfd0913c350 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/c16908589b9241048e82abfd0913c350 2023-08-25 17:01:16,870 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/37d200bf1f1e4a2a86c50ae124dbc1d6 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/37d200bf1f1e4a2a86c50ae124dbc1d6 2023-08-25 17:01:16,872 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/8e045a27bcf246faaece41a7ae96492d to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/8e045a27bcf246faaece41a7ae96492d 2023-08-25 17:01:16,873 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/d4d57bd0be9a4309b66ecccc9de3caa5 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/d4d57bd0be9a4309b66ecccc9de3caa5 2023-08-25 17:01:16,874 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/47b9751f8b4c441697d00b25bd1dc8ef to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/47b9751f8b4c441697d00b25bd1dc8ef 2023-08-25 17:01:16,875 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/a38b6197281e413fa6d780867f893170 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/a38b6197281e413fa6d780867f893170 2023-08-25 17:01:16,876 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/1bfc4f9220994133af6cfd2e258b8af4 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/1bfc4f9220994133af6cfd2e258b8af4 2023-08-25 17:01:16,877 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/cca3cfd8081348a3903efa0a7145a280 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/cca3cfd8081348a3903efa0a7145a280 2023-08-25 17:01:16,878 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/93157f24a29f4e87b322f032df9de4d8 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/93157f24a29f4e87b322f032df9de4d8 2023-08-25 17:01:16,879 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/a4f3ef90600f4cc89efbbde1efe7293e to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/a4f3ef90600f4cc89efbbde1efe7293e 2023-08-25 17:01:16,880 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/3ccb12c2dc2446d082f4aebd672c5566 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/info/3ccb12c2dc2446d082f4aebd672c5566 2023-08-25 17:01:16,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/cb19b2ddc803809f3b21f9ccc1a6ebdc/recovered.edits/328.seqid, newMaxSeqId=328, maxSeqId=123 2023-08-25 17:01:16,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:01:16,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cb19b2ddc803809f3b21f9ccc1a6ebdc: 2023-08-25 17:01:16,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,row0064,1692982834241.cb19b2ddc803809f3b21f9ccc1a6ebdc. 2023-08-25 17:01:16,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b47a3ed0187be817b6f5b11a8ecb6514, disabling compactions & flushes 2023-08-25 17:01:16,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514. 2023-08-25 17:01:16,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514. 2023-08-25 17:01:16,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514. after waiting 0 ms 2023-08-25 17:01:16,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514. 2023-08-25 17:01:16,886 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514/info/2643fa95c12d40e7ae0e058ca0cc38f9.f28eb01c00ac51074e0973e8c7ef03b5->hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/f28eb01c00ac51074e0973e8c7ef03b5/info/2643fa95c12d40e7ae0e058ca0cc38f9-bottom] to archive 2023-08-25 17:01:16,887 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-25 17:01:16,889 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514/info/2643fa95c12d40e7ae0e058ca0cc38f9.f28eb01c00ac51074e0973e8c7ef03b5 to hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/archive/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514/info/2643fa95c12d40e7ae0e058ca0cc38f9.f28eb01c00ac51074e0973e8c7ef03b5 2023-08-25 17:01:16,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/default/TestLogRolling-testLogRolling/b47a3ed0187be817b6f5b11a8ecb6514/recovered.edits/128.seqid, newMaxSeqId=128, maxSeqId=123 2023-08-25 17:01:16,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514. 2023-08-25 17:01:16,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b47a3ed0187be817b6f5b11a8ecb6514: 2023-08-25 17:01:16,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,,1692982834241.b47a3ed0187be817b6f5b11a8ecb6514. 2023-08-25 17:01:16,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 469f30df4f0d73a5b5ab554fabb8011c, disabling compactions & flushes 2023-08-25 17:01:16,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. 2023-08-25 17:01:16,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. 2023-08-25 17:01:16,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. after waiting 0 ms 2023-08-25 17:01:16,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. 2023-08-25 17:01:16,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/data/hbase/namespace/469f30df4f0d73a5b5ab554fabb8011c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-25 17:01:16,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. 2023-08-25 17:01:16,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 469f30df4f0d73a5b5ab554fabb8011c: 2023-08-25 17:01:16,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1692982809364.469f30df4f0d73a5b5ab554fabb8011c. 2023-08-25 17:01:17,043 INFO [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39919,1692982808794; all regions closed. 2023-08-25 17:01:17,047 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-25 17:01:17,048 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-25 17:01:17,048 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-25 17:01:17,049 DEBUG [RS:0;jenkins-hbase4:39919] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/oldWALs 2023-08-25 17:01:17,049 INFO [RS:0;jenkins-hbase4:39919] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39919%2C1692982808794.meta:.meta(num 1692982809305) 2023-08-25 17:01:17,054 DEBUG [RS:0;jenkins-hbase4:39919] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/oldWALs 2023-08-25 17:01:17,054 INFO [RS:0;jenkins-hbase4:39919] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39919%2C1692982808794:(num 1692982876713) 2023-08-25 17:01:17,054 DEBUG [RS:0;jenkins-hbase4:39919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:01:17,054 INFO [RS:0;jenkins-hbase4:39919] regionserver.LeaseManager(133): Closed leases 2023-08-25 17:01:17,054 INFO [RS:0;jenkins-hbase4:39919] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-25 17:01:17,054 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-25 17:01:17,055 INFO [RS:0;jenkins-hbase4:39919] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39919 2023-08-25 17:01:17,058 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-25 17:01:17,058 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39919,1692982808794 2023-08-25 17:01:17,058 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-25 17:01:17,060 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39919,1692982808794] 2023-08-25 17:01:17,060 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39919,1692982808794; numProcessing=1 2023-08-25 17:01:17,061 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39919,1692982808794 already deleted, retry=false 2023-08-25 17:01:17,061 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39919,1692982808794 expired; onlineServers=0 2023-08-25 17:01:17,062 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44471,1692982808750' ***** 2023-08-25 17:01:17,062 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-25 17:01:17,062 DEBUG [M:0;jenkins-hbase4:44471] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f74a522, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-25 17:01:17,062 INFO [M:0;jenkins-hbase4:44471] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44471,1692982808750 2023-08-25 17:01:17,062 INFO [M:0;jenkins-hbase4:44471] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44471,1692982808750; all regions closed. 2023-08-25 17:01:17,062 DEBUG [M:0;jenkins-hbase4:44471] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:01:17,062 DEBUG [M:0;jenkins-hbase4:44471] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-25 17:01:17,062 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-25 17:01:17,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1692982808947] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1692982808947,5,FailOnTimeoutGroup] 2023-08-25 17:01:17,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1692982808947] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1692982808947,5,FailOnTimeoutGroup] 2023-08-25 17:01:17,062 DEBUG [M:0;jenkins-hbase4:44471] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-25 17:01:17,063 INFO [M:0;jenkins-hbase4:44471] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-25 17:01:17,063 INFO [M:0;jenkins-hbase4:44471] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-25 17:01:17,063 INFO [M:0;jenkins-hbase4:44471] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-25 17:01:17,064 DEBUG [M:0;jenkins-hbase4:44471] master.HMaster(1512): Stopping service threads 2023-08-25 17:01:17,064 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-25 17:01:17,064 INFO [M:0;jenkins-hbase4:44471] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-25 17:01:17,064 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:17,064 ERROR [M:0;jenkins-hbase4:44471] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-08-25 17:01:17,064 INFO [M:0;jenkins-hbase4:44471] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-25 17:01:17,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-25 17:01:17,064 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-25 17:01:17,065 DEBUG [M:0;jenkins-hbase4:44471] zookeeper.ZKUtil(398): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-25 17:01:17,065 WARN [M:0;jenkins-hbase4:44471] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-25 17:01:17,065 INFO [M:0;jenkins-hbase4:44471] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-25 17:01:17,065 INFO [M:0;jenkins-hbase4:44471] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-25 17:01:17,065 DEBUG [M:0;jenkins-hbase4:44471] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-25 17:01:17,065 INFO [M:0;jenkins-hbase4:44471] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:01:17,065 DEBUG [M:0;jenkins-hbase4:44471] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:01:17,065 DEBUG [M:0;jenkins-hbase4:44471] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-25 17:01:17,065 DEBUG [M:0;jenkins-hbase4:44471] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:01:17,066 INFO [M:0;jenkins-hbase4:44471] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=64.70 KB heapSize=78.42 KB 2023-08-25 17:01:17,077 INFO [M:0;jenkins-hbase4:44471] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64.70 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ed90b5dffb004ae1b96c3e920519ce1c 2023-08-25 17:01:17,082 INFO [M:0;jenkins-hbase4:44471] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed90b5dffb004ae1b96c3e920519ce1c 2023-08-25 17:01:17,083 DEBUG [M:0;jenkins-hbase4:44471] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ed90b5dffb004ae1b96c3e920519ce1c as hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ed90b5dffb004ae1b96c3e920519ce1c 2023-08-25 17:01:17,089 INFO [M:0;jenkins-hbase4:44471] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed90b5dffb004ae1b96c3e920519ce1c 2023-08-25 17:01:17,089 INFO [M:0;jenkins-hbase4:44471] regionserver.HStore(1080): Added hdfs://localhost:40743/user/jenkins/test-data/3baff279-41bd-02d4-cc63-9ec64108649b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ed90b5dffb004ae1b96c3e920519ce1c, entries=18, sequenceid=160, filesize=6.9 K 2023-08-25 17:01:17,089 INFO [M:0;jenkins-hbase4:44471] regionserver.HRegion(2948): Finished flush of dataSize ~64.70 KB/66256, heapSize ~78.41 KB/80288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=160, compaction requested=false 2023-08-25 17:01:17,090 INFO [M:0;jenkins-hbase4:44471] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:01:17,090 DEBUG [M:0;jenkins-hbase4:44471] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-25 17:01:17,093 INFO [M:0;jenkins-hbase4:44471] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-25 17:01:17,093 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-25 17:01:17,093 INFO [M:0;jenkins-hbase4:44471] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44471 2023-08-25 17:01:17,095 DEBUG [M:0;jenkins-hbase4:44471] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44471,1692982808750 already deleted, retry=false 2023-08-25 17:01:17,160 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 17:01:17,160 INFO [RS:0;jenkins-hbase4:39919] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39919,1692982808794; zookeeper connection closed. 2023-08-25 17:01:17,161 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): regionserver:39919-0x1004462c8400001, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 17:01:17,161 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1f0bccb3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1f0bccb3 2023-08-25 17:01:17,161 INFO [Listener at localhost/46709] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-25 17:01:17,261 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 17:01:17,261 INFO [M:0;jenkins-hbase4:44471] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44471,1692982808750; zookeeper connection closed. 2023-08-25 17:01:17,261 DEBUG [Listener at localhost/46709-EventThread] zookeeper.ZKWatcher(600): master:44471-0x1004462c8400000, quorum=127.0.0.1:59206, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 17:01:17,262 WARN [Listener at localhost/46709] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-25 17:01:17,265 INFO [Listener at localhost/46709] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 17:01:17,370 WARN [BP-599806488-172.31.14.131-1692982808206 heartbeating to localhost/127.0.0.1:40743] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-25 17:01:17,370 WARN [BP-599806488-172.31.14.131-1692982808206 heartbeating to localhost/127.0.0.1:40743] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-599806488-172.31.14.131-1692982808206 (Datanode Uuid c66e5d95-cf5d-4a4d-bbe0-0188aebd3ac1) service to localhost/127.0.0.1:40743 2023-08-25 17:01:17,371 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/cluster_0fc31d72-d2d0-bf14-3999-23a2d45691e4/dfs/data/data3/current/BP-599806488-172.31.14.131-1692982808206] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 17:01:17,371 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/cluster_0fc31d72-d2d0-bf14-3999-23a2d45691e4/dfs/data/data4/current/BP-599806488-172.31.14.131-1692982808206] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 17:01:17,372 WARN [Listener at localhost/46709] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-25 17:01:17,376 INFO [Listener at localhost/46709] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 17:01:17,480 WARN [BP-599806488-172.31.14.131-1692982808206 heartbeating to localhost/127.0.0.1:40743] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-25 17:01:17,480 WARN [BP-599806488-172.31.14.131-1692982808206 heartbeating to localhost/127.0.0.1:40743] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-599806488-172.31.14.131-1692982808206 (Datanode Uuid b912f006-dddc-439a-acd1-b63e491198bf) service to localhost/127.0.0.1:40743 2023-08-25 17:01:17,481 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/cluster_0fc31d72-d2d0-bf14-3999-23a2d45691e4/dfs/data/data1/current/BP-599806488-172.31.14.131-1692982808206] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 17:01:17,481 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/cluster_0fc31d72-d2d0-bf14-3999-23a2d45691e4/dfs/data/data2/current/BP-599806488-172.31.14.131-1692982808206] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 17:01:17,493 INFO [Listener at localhost/46709] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 17:01:17,609 INFO [Listener at localhost/46709] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-25 17:01:17,648 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-25 17:01:17,658 INFO [Listener at localhost/46709] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=75 (was 65) - Thread LEAK? -, OpenFileDescriptor=462 (was 442) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=61 (was 129), ProcessCount=167 (was 170), AvailableMemoryMB=6991 (was 7048) 2023-08-25 17:01:17,666 INFO [Listener at localhost/46709] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=76, OpenFileDescriptor=462, MaxFileDescriptor=60000, SystemLoadAverage=61, ProcessCount=167, AvailableMemoryMB=6990 2023-08-25 17:01:17,666 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-25 17:01:17,666 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/hadoop.log.dir so I do NOT create it in target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4 2023-08-25 17:01:17,666 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/96d11d56-5154-d8ea-b2d3-f786660f890e/hadoop.tmp.dir so I do NOT create it in target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4 2023-08-25 17:01:17,666 INFO [Listener at localhost/46709] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/cluster_a6ad287e-1f1e-133b-b87c-d44320a44f9f, deleteOnExit=true 2023-08-25 17:01:17,666 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-25 17:01:17,666 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/test.cache.data in system properties and HBase conf 2023-08-25 17:01:17,666 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/hadoop.tmp.dir in system properties and HBase conf 2023-08-25 17:01:17,666 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/hadoop.log.dir in system properties and HBase conf 2023-08-25 17:01:17,667 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-25 17:01:17,667 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-25 17:01:17,667 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-25 17:01:17,667 DEBUG [Listener at localhost/46709] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-25 17:01:17,667 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-25 17:01:17,667 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-25 17:01:17,667 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-25 17:01:17,667 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-25 17:01:17,667 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-25 17:01:17,668 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-25 17:01:17,668 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-25 17:01:17,668 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-25 17:01:17,668 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-25 17:01:17,668 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/nfs.dump.dir in system properties and HBase conf 2023-08-25 17:01:17,668 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/java.io.tmpdir in system properties and HBase conf 2023-08-25 17:01:17,668 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-25 17:01:17,668 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-25 17:01:17,668 INFO [Listener at localhost/46709] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-25 17:01:17,673 WARN [Listener at localhost/46709] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-25 17:01:17,673 WARN [Listener at localhost/46709] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-25 17:01:17,713 WARN [Listener at localhost/46709] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 17:01:17,715 INFO [Listener at localhost/46709] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 17:01:17,719 INFO [Listener at localhost/46709] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/java.io.tmpdir/Jetty_localhost_38273_hdfs____.ycgz0t/webapp 2023-08-25 17:01:17,811 INFO [Listener at localhost/46709] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38273 2023-08-25 17:01:17,815 WARN [Listener at localhost/46709] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-25 17:01:17,815 WARN [Listener at localhost/46709] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-25 17:01:17,857 WARN [Listener at localhost/33071] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 17:01:17,872 WARN [Listener at localhost/33071] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-25 17:01:17,874 WARN [Listener at localhost/33071] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 17:01:17,875 INFO [Listener at localhost/33071] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 17:01:17,879 INFO [Listener at localhost/33071] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/java.io.tmpdir/Jetty_localhost_36695_datanode____.9thzii/webapp 2023-08-25 17:01:17,969 INFO [Listener at localhost/33071] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36695 2023-08-25 17:01:17,975 WARN [Listener at localhost/42255] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 17:01:17,985 WARN [Listener at localhost/42255] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-25 17:01:17,987 WARN [Listener at localhost/42255] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-25 17:01:17,988 INFO [Listener at localhost/42255] log.Slf4jLog(67): jetty-6.1.26 2023-08-25 17:01:17,991 INFO [Listener at localhost/42255] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/java.io.tmpdir/Jetty_localhost_39133_datanode____.swpa3y/webapp 2023-08-25 17:01:18,083 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb0908997cf83b51: Processing first storage report for DS-0654c90f-a69c-434b-b5c6-a603251da257 from datanode 95151247-8c02-43f1-b2ef-e408a83ca029 2023-08-25 17:01:18,083 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb0908997cf83b51: from storage DS-0654c90f-a69c-434b-b5c6-a603251da257 node DatanodeRegistration(127.0.0.1:37687, datanodeUuid=95151247-8c02-43f1-b2ef-e408a83ca029, infoPort=42607, infoSecurePort=0, ipcPort=42255, storageInfo=lv=-57;cid=testClusterID;nsid=595436167;c=1692982877676), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 17:01:18,084 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb0908997cf83b51: Processing first storage report for DS-48681b34-1da3-4b25-afb7-770c6cc31486 from datanode 95151247-8c02-43f1-b2ef-e408a83ca029 2023-08-25 17:01:18,084 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb0908997cf83b51: from storage DS-48681b34-1da3-4b25-afb7-770c6cc31486 node DatanodeRegistration(127.0.0.1:37687, datanodeUuid=95151247-8c02-43f1-b2ef-e408a83ca029, infoPort=42607, infoSecurePort=0, ipcPort=42255, storageInfo=lv=-57;cid=testClusterID;nsid=595436167;c=1692982877676), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 17:01:18,103 INFO [Listener at localhost/42255] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39133 2023-08-25 17:01:18,109 WARN [Listener at localhost/46179] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-25 17:01:18,199 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xceee5d57bbbe6ea4: Processing first storage report for DS-7759d928-1895-411e-985d-d0830509a915 from datanode 3100818b-a58f-4f2e-b743-ffc0a4b8c688 2023-08-25 17:01:18,199 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xceee5d57bbbe6ea4: from storage DS-7759d928-1895-411e-985d-d0830509a915 node DatanodeRegistration(127.0.0.1:43429, datanodeUuid=3100818b-a58f-4f2e-b743-ffc0a4b8c688, infoPort=36201, infoSecurePort=0, ipcPort=46179, storageInfo=lv=-57;cid=testClusterID;nsid=595436167;c=1692982877676), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 17:01:18,199 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xceee5d57bbbe6ea4: Processing first storage report for DS-44f12d87-6a98-44b6-bc4b-530a20076fc2 from datanode 3100818b-a58f-4f2e-b743-ffc0a4b8c688 2023-08-25 17:01:18,199 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xceee5d57bbbe6ea4: from storage DS-44f12d87-6a98-44b6-bc4b-530a20076fc2 node DatanodeRegistration(127.0.0.1:43429, datanodeUuid=3100818b-a58f-4f2e-b743-ffc0a4b8c688, infoPort=36201, infoSecurePort=0, ipcPort=46179, storageInfo=lv=-57;cid=testClusterID;nsid=595436167;c=1692982877676), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-25 17:01:18,215 DEBUG [Listener at localhost/46179] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4 2023-08-25 17:01:18,217 INFO [Listener at localhost/46179] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/cluster_a6ad287e-1f1e-133b-b87c-d44320a44f9f/zookeeper_0, clientPort=65017, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/cluster_a6ad287e-1f1e-133b-b87c-d44320a44f9f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/cluster_a6ad287e-1f1e-133b-b87c-d44320a44f9f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-25 17:01:18,218 INFO [Listener at localhost/46179] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=65017 2023-08-25 17:01:18,219 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:01:18,219 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:01:18,235 INFO [Listener at localhost/46179] util.FSUtils(471): Created version file at hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f with version=8 2023-08-25 17:01:18,235 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:41217/user/jenkins/test-data/8120ffb1-dd86-68d5-846f-df6188b0654a/hbase-staging 2023-08-25 17:01:18,236 INFO [Listener at localhost/46179] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-25 17:01:18,236 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 17:01:18,237 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-25 17:01:18,237 INFO [Listener at localhost/46179] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-25 17:01:18,237 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 17:01:18,237 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-25 17:01:18,237 INFO [Listener at localhost/46179] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-25 17:01:18,238 INFO [Listener at localhost/46179] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39431 2023-08-25 17:01:18,239 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:01:18,239 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:01:18,240 INFO [Listener at localhost/46179] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39431 connecting to ZooKeeper ensemble=127.0.0.1:65017 2023-08-25 17:01:18,247 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:394310x0, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-25 17:01:18,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39431-0x1004463d7af0000 connected 2023-08-25 17:01:18,261 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-25 17:01:18,261 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 17:01:18,262 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-25 17:01:18,262 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39431 2023-08-25 17:01:18,262 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39431 2023-08-25 17:01:18,263 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39431 2023-08-25 17:01:18,263 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39431 2023-08-25 17:01:18,263 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39431 2023-08-25 17:01:18,263 INFO [Listener at localhost/46179] master.HMaster(444): hbase.rootdir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f, hbase.cluster.distributed=false 2023-08-25 17:01:18,276 INFO [Listener at localhost/46179] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-25 17:01:18,276 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 17:01:18,276 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-25 17:01:18,276 INFO [Listener at localhost/46179] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-25 17:01:18,276 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-25 17:01:18,277 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-25 17:01:18,277 INFO [Listener at localhost/46179] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-25 17:01:18,278 INFO [Listener at localhost/46179] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33869 2023-08-25 17:01:18,279 INFO [Listener at localhost/46179] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-25 17:01:18,279 DEBUG [Listener at localhost/46179] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-25 17:01:18,280 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:01:18,281 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:01:18,283 INFO [Listener at localhost/46179] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33869 connecting to ZooKeeper ensemble=127.0.0.1:65017 2023-08-25 17:01:18,285 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:338690x0, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-25 17:01:18,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33869-0x1004463d7af0001 connected 2023-08-25 17:01:18,287 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-25 17:01:18,287 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 17:01:18,288 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-25 17:01:18,288 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33869 2023-08-25 17:01:18,289 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33869 2023-08-25 17:01:18,289 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33869 2023-08-25 17:01:18,289 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33869 2023-08-25 17:01:18,289 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33869 2023-08-25 17:01:18,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39431,1692982878236 2023-08-25 17:01:18,292 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-25 17:01:18,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39431,1692982878236 2023-08-25 17:01:18,293 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-25 17:01:18,293 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-25 17:01:18,293 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:18,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-25 17:01:18,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39431,1692982878236 from backup master directory 2023-08-25 17:01:18,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-25 17:01:18,297 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39431,1692982878236 2023-08-25 17:01:18,297 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-25 17:01:18,297 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-25 17:01:18,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39431,1692982878236 2023-08-25 17:01:18,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/hbase.id with ID: 2128c85c-a16c-4c24-8596-6fdbdd1faf3e 2023-08-25 17:01:18,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:01:18,324 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:18,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3812da5c to 127.0.0.1:65017 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-25 17:01:18,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3df31a6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-25 17:01:18,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-25 17:01:18,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-25 17:01:18,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 17:01:18,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/data/master/store-tmp 2023-08-25 17:01:18,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:01:18,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-25 17:01:18,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:01:18,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:01:18,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-25 17:01:18,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:01:18,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:01:18,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-25 17:01:18,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/WALs/jenkins-hbase4.apache.org,39431,1692982878236 2023-08-25 17:01:18,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39431%2C1692982878236, suffix=, logDir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/WALs/jenkins-hbase4.apache.org,39431,1692982878236, archiveDir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/oldWALs, maxLogs=10 2023-08-25 17:01:18,361 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43429,DS-7759d928-1895-411e-985d-d0830509a915,DISK] 2023-08-25 17:01:18,361 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37687,DS-0654c90f-a69c-434b-b5c6-a603251da257,DISK] 2023-08-25 17:01:18,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/WALs/jenkins-hbase4.apache.org,39431,1692982878236/jenkins-hbase4.apache.org%2C39431%2C1692982878236.1692982878347 2023-08-25 17:01:18,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43429,DS-7759d928-1895-411e-985d-d0830509a915,DISK], DatanodeInfoWithStorage[127.0.0.1:37687,DS-0654c90f-a69c-434b-b5c6-a603251da257,DISK]] 2023-08-25 17:01:18,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-25 17:01:18,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:01:18,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-25 17:01:18,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-25 17:01:18,365 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-25 17:01:18,367 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-25 17:01:18,367 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-25 17:01:18,367 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:01:18,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-25 17:01:18,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-25 17:01:18,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-25 17:01:18,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 17:01:18,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=768186, jitterRate=-0.023201197385787964}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 17:01:18,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-25 17:01:18,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-25 17:01:18,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-25 17:01:18,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-25 17:01:18,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-25 17:01:18,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-25 17:01:18,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-25 17:01:18,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-25 17:01:18,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-25 17:01:18,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-25 17:01:18,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-25 17:01:18,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-25 17:01:18,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-25 17:01:18,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-25 17:01:18,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-25 17:01:18,391 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:18,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-25 17:01:18,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-25 17:01:18,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-25 17:01:18,396 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-25 17:01:18,396 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-25 17:01:18,396 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:18,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39431,1692982878236, sessionid=0x1004463d7af0000, setting cluster-up flag (Was=false) 2023-08-25 17:01:18,400 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:18,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-25 17:01:18,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39431,1692982878236 2023-08-25 17:01:18,408 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:18,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-25 17:01:18,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39431,1692982878236 2023-08-25 17:01:18,413 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/.hbase-snapshot/.tmp 2023-08-25 17:01:18,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-25 17:01:18,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 17:01:18,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 17:01:18,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 17:01:18,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-25 17:01:18,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-25 17:01:18,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:01:18,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-25 17:01:18,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:01:18,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1692982908416 2023-08-25 17:01:18,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-25 17:01:18,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-25 17:01:18,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-25 17:01:18,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-25 17:01:18,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-25 17:01:18,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-25 17:01:18,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,417 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-25 17:01:18,417 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-25 17:01:18,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-25 17:01:18,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-25 17:01:18,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-25 17:01:18,418 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-25 17:01:18,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-25 17:01:18,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-25 17:01:18,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1692982878420,5,FailOnTimeoutGroup] 2023-08-25 17:01:18,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1692982878420,5,FailOnTimeoutGroup] 2023-08-25 17:01:18,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-25 17:01:18,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,427 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-25 17:01:18,428 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-25 17:01:18,428 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f 2023-08-25 17:01:18,434 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:01:18,435 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-25 17:01:18,437 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/info 2023-08-25 17:01:18,437 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-25 17:01:18,438 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:01:18,438 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-25 17:01:18,439 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/rep_barrier 2023-08-25 17:01:18,439 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-25 17:01:18,440 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:01:18,440 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-25 17:01:18,441 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/table 2023-08-25 17:01:18,441 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-25 17:01:18,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:01:18,442 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740 2023-08-25 17:01:18,443 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740 2023-08-25 17:01:18,445 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-25 17:01:18,446 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-25 17:01:18,448 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 17:01:18,448 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=717134, jitterRate=-0.08811821043491364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-25 17:01:18,448 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-25 17:01:18,448 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-25 17:01:18,448 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-25 17:01:18,448 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-25 17:01:18,448 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-25 17:01:18,448 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-25 17:01:18,449 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-25 17:01:18,449 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-25 17:01:18,449 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-25 17:01:18,449 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-25 17:01:18,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-25 17:01:18,450 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-25 17:01:18,451 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-25 17:01:18,491 INFO [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(951): ClusterId : 2128c85c-a16c-4c24-8596-6fdbdd1faf3e 2023-08-25 17:01:18,492 DEBUG [RS:0;jenkins-hbase4:33869] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-25 17:01:18,494 DEBUG [RS:0;jenkins-hbase4:33869] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-25 17:01:18,494 DEBUG [RS:0;jenkins-hbase4:33869] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-25 17:01:18,496 DEBUG [RS:0;jenkins-hbase4:33869] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-25 17:01:18,497 DEBUG [RS:0;jenkins-hbase4:33869] zookeeper.ReadOnlyZKClient(139): Connect 0x4c0db68d to 127.0.0.1:65017 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-25 17:01:18,500 DEBUG [RS:0;jenkins-hbase4:33869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42ca417c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-25 17:01:18,500 DEBUG [RS:0;jenkins-hbase4:33869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46f5ddfd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-25 17:01:18,509 DEBUG [RS:0;jenkins-hbase4:33869] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33869 2023-08-25 17:01:18,509 INFO [RS:0;jenkins-hbase4:33869] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-25 17:01:18,509 INFO [RS:0;jenkins-hbase4:33869] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-25 17:01:18,509 DEBUG [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(1022): About to register with Master. 2023-08-25 17:01:18,510 INFO [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39431,1692982878236 with isa=jenkins-hbase4.apache.org/172.31.14.131:33869, startcode=1692982878276 2023-08-25 17:01:18,510 DEBUG [RS:0;jenkins-hbase4:33869] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-25 17:01:18,512 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42961, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-08-25 17:01:18,513 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39431] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33869,1692982878276 2023-08-25 17:01:18,513 DEBUG [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f 2023-08-25 17:01:18,513 DEBUG [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33071 2023-08-25 17:01:18,513 DEBUG [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-25 17:01:18,514 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-25 17:01:18,515 DEBUG [RS:0;jenkins-hbase4:33869] zookeeper.ZKUtil(162): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33869,1692982878276 2023-08-25 17:01:18,515 WARN [RS:0;jenkins-hbase4:33869] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-25 17:01:18,515 INFO [RS:0;jenkins-hbase4:33869] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 17:01:18,515 DEBUG [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/WALs/jenkins-hbase4.apache.org,33869,1692982878276 2023-08-25 17:01:18,515 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33869,1692982878276] 2023-08-25 17:01:18,519 DEBUG [RS:0;jenkins-hbase4:33869] zookeeper.ZKUtil(162): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33869,1692982878276 2023-08-25 17:01:18,520 DEBUG [RS:0;jenkins-hbase4:33869] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-25 17:01:18,520 INFO [RS:0;jenkins-hbase4:33869] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-25 17:01:18,521 INFO [RS:0;jenkins-hbase4:33869] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-25 17:01:18,522 INFO [RS:0;jenkins-hbase4:33869] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-25 17:01:18,522 INFO [RS:0;jenkins-hbase4:33869] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,522 INFO [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-25 17:01:18,523 INFO [RS:0;jenkins-hbase4:33869] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,523 DEBUG [RS:0;jenkins-hbase4:33869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:01:18,523 DEBUG [RS:0;jenkins-hbase4:33869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:01:18,523 DEBUG [RS:0;jenkins-hbase4:33869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:01:18,523 DEBUG [RS:0;jenkins-hbase4:33869] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:01:18,523 DEBUG [RS:0;jenkins-hbase4:33869] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:01:18,523 DEBUG [RS:0;jenkins-hbase4:33869] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-25 17:01:18,523 DEBUG [RS:0;jenkins-hbase4:33869] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:01:18,523 DEBUG [RS:0;jenkins-hbase4:33869] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:01:18,523 DEBUG [RS:0;jenkins-hbase4:33869] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:01:18,523 DEBUG [RS:0;jenkins-hbase4:33869] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-25 17:01:18,525 INFO [RS:0;jenkins-hbase4:33869] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,525 INFO [RS:0;jenkins-hbase4:33869] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,525 INFO [RS:0;jenkins-hbase4:33869] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,538 INFO [RS:0;jenkins-hbase4:33869] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-25 17:01:18,539 INFO [RS:0;jenkins-hbase4:33869] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33869,1692982878276-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,549 INFO [RS:0;jenkins-hbase4:33869] regionserver.Replication(203): jenkins-hbase4.apache.org,33869,1692982878276 started 2023-08-25 17:01:18,549 INFO [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33869,1692982878276, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33869, sessionid=0x1004463d7af0001 2023-08-25 17:01:18,549 DEBUG [RS:0;jenkins-hbase4:33869] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-25 17:01:18,549 DEBUG [RS:0;jenkins-hbase4:33869] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33869,1692982878276 2023-08-25 17:01:18,549 DEBUG [RS:0;jenkins-hbase4:33869] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33869,1692982878276' 2023-08-25 17:01:18,549 DEBUG [RS:0;jenkins-hbase4:33869] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-25 17:01:18,549 DEBUG [RS:0;jenkins-hbase4:33869] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-25 17:01:18,550 DEBUG [RS:0;jenkins-hbase4:33869] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-25 17:01:18,550 DEBUG [RS:0;jenkins-hbase4:33869] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-25 17:01:18,550 DEBUG [RS:0;jenkins-hbase4:33869] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33869,1692982878276 2023-08-25 17:01:18,550 DEBUG [RS:0;jenkins-hbase4:33869] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33869,1692982878276' 2023-08-25 17:01:18,550 DEBUG [RS:0;jenkins-hbase4:33869] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-25 17:01:18,550 DEBUG [RS:0;jenkins-hbase4:33869] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-25 17:01:18,551 DEBUG [RS:0;jenkins-hbase4:33869] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-25 17:01:18,551 INFO [RS:0;jenkins-hbase4:33869] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-25 17:01:18,551 INFO [RS:0;jenkins-hbase4:33869] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-25 17:01:18,602 DEBUG [jenkins-hbase4:39431] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-25 17:01:18,602 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33869,1692982878276, state=OPENING 2023-08-25 17:01:18,604 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-25 17:01:18,606 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:18,606 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-25 17:01:18,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33869,1692982878276}] 2023-08-25 17:01:18,652 INFO [RS:0;jenkins-hbase4:33869] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33869%2C1692982878276, suffix=, logDir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/WALs/jenkins-hbase4.apache.org,33869,1692982878276, archiveDir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/oldWALs, maxLogs=32 2023-08-25 17:01:18,668 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37687,DS-0654c90f-a69c-434b-b5c6-a603251da257,DISK] 2023-08-25 17:01:18,668 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43429,DS-7759d928-1895-411e-985d-d0830509a915,DISK] 2023-08-25 17:01:18,671 INFO [RS:0;jenkins-hbase4:33869] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/WALs/jenkins-hbase4.apache.org,33869,1692982878276/jenkins-hbase4.apache.org%2C33869%2C1692982878276.1692982878653 2023-08-25 17:01:18,671 DEBUG [RS:0;jenkins-hbase4:33869] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37687,DS-0654c90f-a69c-434b-b5c6-a603251da257,DISK], DatanodeInfoWithStorage[127.0.0.1:43429,DS-7759d928-1895-411e-985d-d0830509a915,DISK]] 2023-08-25 17:01:18,760 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33869,1692982878276 2023-08-25 17:01:18,760 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-25 17:01:18,762 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-25 17:01:18,766 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-25 17:01:18,766 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 17:01:18,768 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33869%2C1692982878276.meta, suffix=.meta, logDir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/WALs/jenkins-hbase4.apache.org,33869,1692982878276, archiveDir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/oldWALs, maxLogs=32 2023-08-25 17:01:18,782 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37687,DS-0654c90f-a69c-434b-b5c6-a603251da257,DISK] 2023-08-25 17:01:18,782 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43429,DS-7759d928-1895-411e-985d-d0830509a915,DISK] 2023-08-25 17:01:18,784 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/WALs/jenkins-hbase4.apache.org,33869,1692982878276/jenkins-hbase4.apache.org%2C33869%2C1692982878276.meta.1692982878768.meta 2023-08-25 17:01:18,784 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37687,DS-0654c90f-a69c-434b-b5c6-a603251da257,DISK], DatanodeInfoWithStorage[127.0.0.1:43429,DS-7759d928-1895-411e-985d-d0830509a915,DISK]] 2023-08-25 17:01:18,784 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-25 17:01:18,784 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-25 17:01:18,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-25 17:01:18,785 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-25 17:01:18,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-25 17:01:18,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:01:18,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-25 17:01:18,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-25 17:01:18,786 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-25 17:01:18,787 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/info 2023-08-25 17:01:18,787 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/info 2023-08-25 17:01:18,787 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-25 17:01:18,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:01:18,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-25 17:01:18,789 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/rep_barrier 2023-08-25 17:01:18,789 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/rep_barrier 2023-08-25 17:01:18,789 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-25 17:01:18,789 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:01:18,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-25 17:01:18,791 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/table 2023-08-25 17:01:18,791 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/table 2023-08-25 17:01:18,791 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-25 17:01:18,791 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:01:18,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740 2023-08-25 17:01:18,794 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740 2023-08-25 17:01:18,796 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-25 17:01:18,797 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-25 17:01:18,798 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=847816, jitterRate=0.07805393636226654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-25 17:01:18,798 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-25 17:01:18,799 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1692982878760 2023-08-25 17:01:18,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-25 17:01:18,802 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-25 17:01:18,803 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33869,1692982878276, state=OPEN 2023-08-25 17:01:18,805 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-25 17:01:18,805 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-25 17:01:18,806 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-25 17:01:18,807 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33869,1692982878276 in 199 msec 2023-08-25 17:01:18,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-25 17:01:18,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 358 msec 2023-08-25 17:01:18,810 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 395 msec 2023-08-25 17:01:18,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1692982878810, completionTime=-1 2023-08-25 17:01:18,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-25 17:01:18,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-25 17:01:18,813 DEBUG [hconnection-0x4cb2ef66-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-25 17:01:18,815 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-25 17:01:18,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-25 17:01:18,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1692982938816 2023-08-25 17:01:18,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1692982998816 2023-08-25 17:01:18,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-08-25 17:01:18,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39431,1692982878236-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39431,1692982878236-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39431,1692982878236-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39431, period=300000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-25 17:01:18,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-25 17:01:18,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-25 17:01:18,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-25 17:01:18,824 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-25 17:01:18,825 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-25 17:01:18,826 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-25 17:01:18,827 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/.tmp/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a 2023-08-25 17:01:18,828 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/.tmp/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a empty. 2023-08-25 17:01:18,828 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/.tmp/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a 2023-08-25 17:01:18,828 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-25 17:01:18,840 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-25 17:01:18,842 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6c9c42b0f7e78ce7de92639db8a3513a, NAME => 'hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/.tmp 2023-08-25 17:01:18,849 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:01:18,849 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 6c9c42b0f7e78ce7de92639db8a3513a, disabling compactions & flushes 2023-08-25 17:01:18,849 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. 2023-08-25 17:01:18,849 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. 2023-08-25 17:01:18,849 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. after waiting 0 ms 2023-08-25 17:01:18,849 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. 2023-08-25 17:01:18,849 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. 2023-08-25 17:01:18,849 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 6c9c42b0f7e78ce7de92639db8a3513a: 2023-08-25 17:01:18,851 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-25 17:01:18,853 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692982878852"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1692982878852"}]},"ts":"1692982878852"} 2023-08-25 17:01:18,854 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-25 17:01:18,855 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-25 17:01:18,855 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982878855"}]},"ts":"1692982878855"} 2023-08-25 17:01:18,856 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-25 17:01:18,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6c9c42b0f7e78ce7de92639db8a3513a, ASSIGN}] 2023-08-25 17:01:18,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6c9c42b0f7e78ce7de92639db8a3513a, ASSIGN 2023-08-25 17:01:18,865 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6c9c42b0f7e78ce7de92639db8a3513a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33869,1692982878276; forceNewPlan=false, retain=false 2023-08-25 17:01:19,016 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6c9c42b0f7e78ce7de92639db8a3513a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33869,1692982878276 2023-08-25 17:01:19,016 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692982879016"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1692982879016"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1692982879016"}]},"ts":"1692982879016"} 2023-08-25 17:01:19,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6c9c42b0f7e78ce7de92639db8a3513a, server=jenkins-hbase4.apache.org,33869,1692982878276}] 2023-08-25 17:01:19,173 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. 2023-08-25 17:01:19,173 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c9c42b0f7e78ce7de92639db8a3513a, NAME => 'hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a.', STARTKEY => '', ENDKEY => ''} 2023-08-25 17:01:19,173 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6c9c42b0f7e78ce7de92639db8a3513a 2023-08-25 17:01:19,173 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-25 17:01:19,173 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6c9c42b0f7e78ce7de92639db8a3513a 2023-08-25 17:01:19,173 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6c9c42b0f7e78ce7de92639db8a3513a 2023-08-25 17:01:19,174 INFO [StoreOpener-6c9c42b0f7e78ce7de92639db8a3513a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6c9c42b0f7e78ce7de92639db8a3513a 2023-08-25 17:01:19,176 DEBUG [StoreOpener-6c9c42b0f7e78ce7de92639db8a3513a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a/info 2023-08-25 17:01:19,176 DEBUG [StoreOpener-6c9c42b0f7e78ce7de92639db8a3513a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a/info 2023-08-25 17:01:19,176 INFO [StoreOpener-6c9c42b0f7e78ce7de92639db8a3513a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c9c42b0f7e78ce7de92639db8a3513a columnFamilyName info 2023-08-25 17:01:19,176 INFO [StoreOpener-6c9c42b0f7e78ce7de92639db8a3513a-1] regionserver.HStore(310): Store=6c9c42b0f7e78ce7de92639db8a3513a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-25 17:01:19,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a 2023-08-25 17:01:19,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a 2023-08-25 17:01:19,181 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6c9c42b0f7e78ce7de92639db8a3513a 2023-08-25 17:01:19,183 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-25 17:01:19,183 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6c9c42b0f7e78ce7de92639db8a3513a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=738924, jitterRate=-0.06040982902050018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-25 17:01:19,183 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6c9c42b0f7e78ce7de92639db8a3513a: 2023-08-25 17:01:19,184 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a., pid=6, masterSystemTime=1692982879169 2023-08-25 17:01:19,185 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. 2023-08-25 17:01:19,185 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. 2023-08-25 17:01:19,186 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6c9c42b0f7e78ce7de92639db8a3513a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33869,1692982878276 2023-08-25 17:01:19,186 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1692982879186"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1692982879186"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1692982879186"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1692982879186"}]},"ts":"1692982879186"} 2023-08-25 17:01:19,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-25 17:01:19,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6c9c42b0f7e78ce7de92639db8a3513a, server=jenkins-hbase4.apache.org,33869,1692982878276 in 170 msec 2023-08-25 17:01:19,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-25 17:01:19,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6c9c42b0f7e78ce7de92639db8a3513a, ASSIGN in 326 msec 2023-08-25 17:01:19,192 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-25 17:01:19,193 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1692982879193"}]},"ts":"1692982879193"} 2023-08-25 17:01:19,194 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-25 17:01:19,196 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-25 17:01:19,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 373 msec 2023-08-25 17:01:19,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-25 17:01:19,227 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-25 17:01:19,228 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:19,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-25 17:01:19,237 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-25 17:01:19,240 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-08-25 17:01:19,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-25 17:01:19,248 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-25 17:01:19,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-08-25 17:01:19,256 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-25 17:01:19,259 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-25 17:01:19,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.962sec 2023-08-25 17:01:19,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-25 17:01:19,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-25 17:01:19,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-25 17:01:19,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39431,1692982878236-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-25 17:01:19,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39431,1692982878236-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-25 17:01:19,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-25 17:01:19,291 DEBUG [Listener at localhost/46179] zookeeper.ReadOnlyZKClient(139): Connect 0x2c152c0a to 127.0.0.1:65017 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-25 17:01:19,297 DEBUG [Listener at localhost/46179] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25b45f79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-25 17:01:19,298 DEBUG [hconnection-0x2f39cb55-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-25 17:01:19,300 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-25 17:01:19,301 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39431,1692982878236 2023-08-25 17:01:19,301 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-25 17:01:19,305 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-25 17:01:19,305 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:19,306 INFO [Listener at localhost/46179] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-25 17:01:19,306 INFO [Listener at localhost/46179] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-25 17:01:19,308 INFO [Listener at localhost/46179] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=test.com%2C8080%2C1, suffix=, logDir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/WALs/test.com,8080,1, archiveDir=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/oldWALs, maxLogs=32 2023-08-25 17:01:19,322 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37687,DS-0654c90f-a69c-434b-b5c6-a603251da257,DISK] 2023-08-25 17:01:19,323 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43429,DS-7759d928-1895-411e-985d-d0830509a915,DISK] 2023-08-25 17:01:19,325 INFO [Listener at localhost/46179] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/WALs/test.com,8080,1/test.com%2C8080%2C1.1692982879308 2023-08-25 17:01:19,326 DEBUG [Listener at localhost/46179] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37687,DS-0654c90f-a69c-434b-b5c6-a603251da257,DISK], DatanodeInfoWithStorage[127.0.0.1:43429,DS-7759d928-1895-411e-985d-d0830509a915,DISK]] 2023-08-25 17:01:19,339 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43429,DS-7759d928-1895-411e-985d-d0830509a915,DISK] 2023-08-25 17:01:19,339 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37687,DS-0654c90f-a69c-434b-b5c6-a603251da257,DISK] 2023-08-25 17:01:19,340 INFO [Listener at localhost/46179] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/WALs/test.com,8080,1/test.com%2C8080%2C1.1692982879308 with entries=0, filesize=83 B; new WAL /user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/WALs/test.com,8080,1/test.com%2C8080%2C1.1692982879326 2023-08-25 17:01:19,341 DEBUG [Listener at localhost/46179] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43429,DS-7759d928-1895-411e-985d-d0830509a915,DISK], DatanodeInfoWithStorage[127.0.0.1:37687,DS-0654c90f-a69c-434b-b5c6-a603251da257,DISK]] 2023-08-25 17:01:19,341 DEBUG [Listener at localhost/46179] wal.AbstractFSWAL(716): hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/WALs/test.com,8080,1/test.com%2C8080%2C1.1692982879308 is not closed yet, will try archiving it next time 2023-08-25 17:01:19,346 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/WALs/test.com,8080,1/test.com%2C8080%2C1.1692982879308 to hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/oldWALs/test.com%2C8080%2C1.1692982879308 2023-08-25 17:01:19,348 DEBUG [Listener at localhost/46179] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/oldWALs 2023-08-25 17:01:19,349 INFO [Listener at localhost/46179] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL test.com%2C8080%2C1:(num 1692982879326) 2023-08-25 17:01:19,349 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-25 17:01:19,349 DEBUG [Listener at localhost/46179] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c152c0a to 127.0.0.1:65017 2023-08-25 17:01:19,349 DEBUG [Listener at localhost/46179] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:01:19,349 DEBUG [Listener at localhost/46179] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-25 17:01:19,350 DEBUG [Listener at localhost/46179] util.JVMClusterUtil(257): Found active master hash=181930738, stopped=false 2023-08-25 17:01:19,350 INFO [Listener at localhost/46179] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39431,1692982878236 2023-08-25 17:01:19,352 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-25 17:01:19,352 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-25 17:01:19,352 INFO [Listener at localhost/46179] procedure2.ProcedureExecutor(629): Stopping 2023-08-25 17:01:19,352 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:19,353 DEBUG [Listener at localhost/46179] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3812da5c to 127.0.0.1:65017 2023-08-25 17:01:19,353 DEBUG [Listener at localhost/46179] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:01:19,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 17:01:19,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-25 17:01:19,353 INFO [Listener at localhost/46179] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33869,1692982878276' ***** 2023-08-25 17:01:19,354 INFO [Listener at localhost/46179] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-25 17:01:19,354 INFO [RS:0;jenkins-hbase4:33869] regionserver.HeapMemoryManager(220): Stopping 2023-08-25 17:01:19,354 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-25 17:01:19,354 INFO [RS:0;jenkins-hbase4:33869] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-25 17:01:19,354 INFO [RS:0;jenkins-hbase4:33869] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-25 17:01:19,354 INFO [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(3305): Received CLOSE for 6c9c42b0f7e78ce7de92639db8a3513a 2023-08-25 17:01:19,355 INFO [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33869,1692982878276 2023-08-25 17:01:19,355 DEBUG [RS:0;jenkins-hbase4:33869] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c0db68d to 127.0.0.1:65017 2023-08-25 17:01:19,355 DEBUG [RS:0;jenkins-hbase4:33869] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:01:19,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6c9c42b0f7e78ce7de92639db8a3513a, disabling compactions & flushes 2023-08-25 17:01:19,355 INFO [RS:0;jenkins-hbase4:33869] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-25 17:01:19,355 INFO [RS:0;jenkins-hbase4:33869] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-25 17:01:19,355 INFO [RS:0;jenkins-hbase4:33869] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-25 17:01:19,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. 2023-08-25 17:01:19,355 INFO [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-25 17:01:19,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. 2023-08-25 17:01:19,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. after waiting 0 ms 2023-08-25 17:01:19,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. 2023-08-25 17:01:19,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6c9c42b0f7e78ce7de92639db8a3513a 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-25 17:01:19,356 INFO [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-08-25 17:01:19,356 DEBUG [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(1478): Online Regions={6c9c42b0f7e78ce7de92639db8a3513a=hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a., 1588230740=hbase:meta,,1.1588230740} 2023-08-25 17:01:19,356 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-25 17:01:19,356 DEBUG [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(1504): Waiting on 1588230740, 6c9c42b0f7e78ce7de92639db8a3513a 2023-08-25 17:01:19,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-25 17:01:19,356 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-25 17:01:19,356 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-25 17:01:19,356 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-25 17:01:19,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=1.26 KB heapSize=2.89 KB 2023-08-25 17:01:19,369 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.17 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/.tmp/info/dd337dafbf454774b44c3524cc896a2d 2023-08-25 17:01:19,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a/.tmp/info/2464e7b57122475fbebebdf3453d7147 2023-08-25 17:01:19,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a/.tmp/info/2464e7b57122475fbebebdf3453d7147 as hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a/info/2464e7b57122475fbebebdf3453d7147 2023-08-25 17:01:19,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a/info/2464e7b57122475fbebebdf3453d7147, entries=2, sequenceid=6, filesize=4.8 K 2023-08-25 17:01:19,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6c9c42b0f7e78ce7de92639db8a3513a in 35ms, sequenceid=6, compaction requested=false 2023-08-25 17:01:19,393 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=94 B at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/.tmp/table/bb11af6b51504994a68351dbe83ced26 2023-08-25 17:01:19,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/namespace/6c9c42b0f7e78ce7de92639db8a3513a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-25 17:01:19,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. 2023-08-25 17:01:19,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6c9c42b0f7e78ce7de92639db8a3513a: 2023-08-25 17:01:19,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1692982878823.6c9c42b0f7e78ce7de92639db8a3513a. 2023-08-25 17:01:19,399 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/.tmp/info/dd337dafbf454774b44c3524cc896a2d as hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/info/dd337dafbf454774b44c3524cc896a2d 2023-08-25 17:01:19,404 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/info/dd337dafbf454774b44c3524cc896a2d, entries=10, sequenceid=9, filesize=5.9 K 2023-08-25 17:01:19,405 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/.tmp/table/bb11af6b51504994a68351dbe83ced26 as hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/table/bb11af6b51504994a68351dbe83ced26 2023-08-25 17:01:19,410 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/table/bb11af6b51504994a68351dbe83ced26, entries=2, sequenceid=9, filesize=4.7 K 2023-08-25 17:01:19,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.26 KB/1290, heapSize ~2.61 KB/2672, currentSize=0 B/0 for 1588230740 in 55ms, sequenceid=9, compaction requested=false 2023-08-25 17:01:19,425 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/data/hbase/meta/1588230740/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-08-25 17:01:19,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-25 17:01:19,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-25 17:01:19,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-25 17:01:19,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-25 17:01:19,556 INFO [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33869,1692982878276; all regions closed. 2023-08-25 17:01:19,561 DEBUG [RS:0;jenkins-hbase4:33869] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/oldWALs 2023-08-25 17:01:19,561 INFO [RS:0;jenkins-hbase4:33869] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33869%2C1692982878276.meta:.meta(num 1692982878768) 2023-08-25 17:01:19,566 DEBUG [RS:0;jenkins-hbase4:33869] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/oldWALs 2023-08-25 17:01:19,567 INFO [RS:0;jenkins-hbase4:33869] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33869%2C1692982878276:(num 1692982878653) 2023-08-25 17:01:19,567 DEBUG [RS:0;jenkins-hbase4:33869] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:01:19,567 INFO [RS:0;jenkins-hbase4:33869] regionserver.LeaseManager(133): Closed leases 2023-08-25 17:01:19,567 INFO [RS:0;jenkins-hbase4:33869] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-08-25 17:01:19,567 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-25 17:01:19,567 INFO [RS:0;jenkins-hbase4:33869] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33869 2023-08-25 17:01:19,571 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33869,1692982878276 2023-08-25 17:01:19,571 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-25 17:01:19,571 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-25 17:01:19,573 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33869,1692982878276] 2023-08-25 17:01:19,573 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33869,1692982878276; numProcessing=1 2023-08-25 17:01:19,574 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33869,1692982878276 already deleted, retry=false 2023-08-25 17:01:19,574 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33869,1692982878276 expired; onlineServers=0 2023-08-25 17:01:19,574 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39431,1692982878236' ***** 2023-08-25 17:01:19,574 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-25 17:01:19,575 DEBUG [M:0;jenkins-hbase4:39431] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ee78f71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-25 17:01:19,575 INFO [M:0;jenkins-hbase4:39431] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39431,1692982878236 2023-08-25 17:01:19,575 INFO [M:0;jenkins-hbase4:39431] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39431,1692982878236; all regions closed. 2023-08-25 17:01:19,575 DEBUG [M:0;jenkins-hbase4:39431] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-25 17:01:19,575 DEBUG [M:0;jenkins-hbase4:39431] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-25 17:01:19,575 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-25 17:01:19,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1692982878420] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1692982878420,5,FailOnTimeoutGroup] 2023-08-25 17:01:19,575 DEBUG [M:0;jenkins-hbase4:39431] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-25 17:01:19,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1692982878420] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1692982878420,5,FailOnTimeoutGroup] 2023-08-25 17:01:19,576 INFO [M:0;jenkins-hbase4:39431] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-25 17:01:19,576 INFO [M:0;jenkins-hbase4:39431] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-25 17:01:19,576 INFO [M:0;jenkins-hbase4:39431] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-25 17:01:19,576 DEBUG [M:0;jenkins-hbase4:39431] master.HMaster(1512): Stopping service threads 2023-08-25 17:01:19,576 INFO [M:0;jenkins-hbase4:39431] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-25 17:01:19,577 ERROR [M:0;jenkins-hbase4:39431] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-7,5,PEWorkerGroup] 2023-08-25 17:01:19,577 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-25 17:01:19,577 INFO [M:0;jenkins-hbase4:39431] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-25 17:01:19,577 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-25 17:01:19,577 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-25 17:01:19,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-25 17:01:19,577 DEBUG [M:0;jenkins-hbase4:39431] zookeeper.ZKUtil(398): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-25 17:01:19,578 WARN [M:0;jenkins-hbase4:39431] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-25 17:01:19,578 INFO [M:0;jenkins-hbase4:39431] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-25 17:01:19,578 INFO [M:0;jenkins-hbase4:39431] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-25 17:01:19,578 DEBUG [M:0;jenkins-hbase4:39431] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-25 17:01:19,578 INFO [M:0;jenkins-hbase4:39431] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:01:19,578 DEBUG [M:0;jenkins-hbase4:39431] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:01:19,578 DEBUG [M:0;jenkins-hbase4:39431] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-25 17:01:19,578 DEBUG [M:0;jenkins-hbase4:39431] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:01:19,579 INFO [M:0;jenkins-hbase4:39431] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=24.07 KB heapSize=29.55 KB 2023-08-25 17:01:19,596 INFO [M:0;jenkins-hbase4:39431] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24.07 KB at sequenceid=66 (bloomFilter=true), to=hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b8d7c7726e9740e7857b82438b9f9a42 2023-08-25 17:01:19,601 DEBUG [M:0;jenkins-hbase4:39431] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b8d7c7726e9740e7857b82438b9f9a42 as hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b8d7c7726e9740e7857b82438b9f9a42 2023-08-25 17:01:19,605 INFO [M:0;jenkins-hbase4:39431] regionserver.HStore(1080): Added hdfs://localhost:33071/user/jenkins/test-data/c483404d-40e5-af76-d683-f078b759a03f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b8d7c7726e9740e7857b82438b9f9a42, entries=8, sequenceid=66, filesize=6.3 K 2023-08-25 17:01:19,605 INFO [M:0;jenkins-hbase4:39431] regionserver.HRegion(2948): Finished flush of dataSize ~24.07 KB/24646, heapSize ~29.54 KB/30248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=66, compaction requested=false 2023-08-25 17:01:19,607 INFO [M:0;jenkins-hbase4:39431] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-25 17:01:19,607 DEBUG [M:0;jenkins-hbase4:39431] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-25 17:01:19,609 INFO [M:0;jenkins-hbase4:39431] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-25 17:01:19,609 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-25 17:01:19,610 INFO [M:0;jenkins-hbase4:39431] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39431 2023-08-25 17:01:19,613 DEBUG [M:0;jenkins-hbase4:39431] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39431,1692982878236 already deleted, retry=false 2023-08-25 17:01:19,754 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 17:01:19,754 INFO [M:0;jenkins-hbase4:39431] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39431,1692982878236; zookeeper connection closed. 2023-08-25 17:01:19,754 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:39431-0x1004463d7af0000, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 17:01:19,854 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 17:01:19,854 INFO [RS:0;jenkins-hbase4:33869] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33869,1692982878276; zookeeper connection closed. 2023-08-25 17:01:19,854 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:33869-0x1004463d7af0001, quorum=127.0.0.1:65017, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-25 17:01:19,855 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@29aa17d5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@29aa17d5 2023-08-25 17:01:19,856 INFO [Listener at localhost/46179] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-25 17:01:19,856 WARN [Listener at localhost/46179] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-25 17:01:19,860 INFO [Listener at localhost/46179] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 17:01:19,963 WARN [BP-1583582266-172.31.14.131-1692982877676 heartbeating to localhost/127.0.0.1:33071] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-25 17:01:19,963 WARN [BP-1583582266-172.31.14.131-1692982877676 heartbeating to localhost/127.0.0.1:33071] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1583582266-172.31.14.131-1692982877676 (Datanode Uuid 3100818b-a58f-4f2e-b743-ffc0a4b8c688) service to localhost/127.0.0.1:33071 2023-08-25 17:01:19,964 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/cluster_a6ad287e-1f1e-133b-b87c-d44320a44f9f/dfs/data/data3/current/BP-1583582266-172.31.14.131-1692982877676] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 17:01:19,964 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/cluster_a6ad287e-1f1e-133b-b87c-d44320a44f9f/dfs/data/data4/current/BP-1583582266-172.31.14.131-1692982877676] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 17:01:19,965 WARN [Listener at localhost/46179] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-25 17:01:19,969 INFO [Listener at localhost/46179] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 17:01:20,073 WARN [BP-1583582266-172.31.14.131-1692982877676 heartbeating to localhost/127.0.0.1:33071] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-25 17:01:20,073 WARN [BP-1583582266-172.31.14.131-1692982877676 heartbeating to localhost/127.0.0.1:33071] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1583582266-172.31.14.131-1692982877676 (Datanode Uuid 95151247-8c02-43f1-b2ef-e408a83ca029) service to localhost/127.0.0.1:33071 2023-08-25 17:01:20,073 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/cluster_a6ad287e-1f1e-133b-b87c-d44320a44f9f/dfs/data/data1/current/BP-1583582266-172.31.14.131-1692982877676] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 17:01:20,074 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/689e38cb-6a0c-f693-1bbb-9ca7e6b0bfc4/cluster_a6ad287e-1f1e-133b-b87c-d44320a44f9f/dfs/data/data2/current/BP-1583582266-172.31.14.131-1692982877676] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-25 17:01:20,087 INFO [Listener at localhost/46179] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-25 17:01:20,198 INFO [Listener at localhost/46179] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-25 17:01:20,212 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-25 17:01:20,222 INFO [Listener at localhost/46179] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=101 (was 76) - Thread LEAK? -, OpenFileDescriptor=496 (was 462) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=61 (was 61), ProcessCount=167 (was 167), AvailableMemoryMB=6984 (was 6990)