2023-08-11 05:58:07,326 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca 2023-08-11 05:58:07,341 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling timeout: 13 mins 2023-08-11 05:58:07,372 INFO [Time-limited test] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=183, ProcessCount=171, AvailableMemoryMB=3761 2023-08-11 05:58:07,379 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-11 05:58:07,379 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7, deleteOnExit=true 2023-08-11 05:58:07,379 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-11 05:58:07,380 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/test.cache.data in system properties and HBase conf 2023-08-11 05:58:07,380 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/hadoop.tmp.dir in system properties and HBase conf 2023-08-11 05:58:07,381 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/hadoop.log.dir in system properties and HBase conf 2023-08-11 05:58:07,381 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-11 05:58:07,382 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-11 05:58:07,382 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-11 05:58:07,488 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-08-11 05:58:07,863 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-11 05:58:07,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-11 05:58:07,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-11 05:58:07,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-11 05:58:07,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 05:58:07,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-11 05:58:07,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-11 05:58:07,869 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 05:58:07,869 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 05:58:07,869 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-11 05:58:07,869 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/nfs.dump.dir in system properties and HBase conf 2023-08-11 05:58:07,870 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/java.io.tmpdir in system properties and HBase conf 2023-08-11 05:58:07,870 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 05:58:07,870 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-11 05:58:07,871 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-11 05:58:08,342 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 05:58:08,347 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 05:58:08,618 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-08-11 05:58:08,762 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-08-11 05:58:08,777 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:58:08,812 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:58:08,871 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/java.io.tmpdir/Jetty_localhost_44547_hdfs____.xm9466/webapp 2023-08-11 05:58:09,008 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44547 2023-08-11 05:58:09,018 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 05:58:09,018 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 05:58:09,451 WARN [Listener at localhost/36289] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:58:09,518 WARN [Listener at localhost/36289] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 05:58:09,537 WARN [Listener at localhost/36289] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:58:09,544 INFO [Listener at localhost/36289] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:58:09,549 INFO [Listener at localhost/36289] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/java.io.tmpdir/Jetty_localhost_41903_datanode____1foxxi/webapp 2023-08-11 05:58:09,647 INFO [Listener at localhost/36289] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41903 2023-08-11 05:58:09,944 WARN [Listener at localhost/42097] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:58:09,954 WARN [Listener at localhost/42097] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 05:58:09,957 WARN [Listener at localhost/42097] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:58:09,959 INFO [Listener at localhost/42097] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:58:09,964 INFO [Listener at localhost/42097] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/java.io.tmpdir/Jetty_localhost_42939_datanode____9tqzd4/webapp 2023-08-11 05:58:10,080 INFO [Listener at localhost/42097] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42939 2023-08-11 05:58:10,090 WARN [Listener at localhost/33971] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:58:10,415 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x707a5e832589da79: Processing first storage report for DS-e570ef3c-b298-4a8a-a766-c4286204eee8 from datanode 8e6892bb-bfc6-4873-8e37-4b5c8104cb51 2023-08-11 05:58:10,416 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x707a5e832589da79: from storage DS-e570ef3c-b298-4a8a-a766-c4286204eee8 node DatanodeRegistration(127.0.0.1:41179, datanodeUuid=8e6892bb-bfc6-4873-8e37-4b5c8104cb51, infoPort=34171, infoSecurePort=0, ipcPort=33971, storageInfo=lv=-57;cid=testClusterID;nsid=831635763;c=1691733488418), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-11 05:58:10,416 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xba88dd89648d6019: Processing first storage report for DS-b54ae1f7-8526-4bc8-be8e-ae4c2f4171c3 from datanode 686fcc46-bbd8-4850-b17d-dc366d189a2f 2023-08-11 05:58:10,417 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xba88dd89648d6019: from storage DS-b54ae1f7-8526-4bc8-be8e-ae4c2f4171c3 node DatanodeRegistration(127.0.0.1:38593, datanodeUuid=686fcc46-bbd8-4850-b17d-dc366d189a2f, infoPort=39779, infoSecurePort=0, ipcPort=42097, storageInfo=lv=-57;cid=testClusterID;nsid=831635763;c=1691733488418), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:58:10,417 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x707a5e832589da79: Processing first storage report for DS-d436e68e-8146-469b-bc77-2fc3049914b6 from datanode 8e6892bb-bfc6-4873-8e37-4b5c8104cb51 2023-08-11 05:58:10,417 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x707a5e832589da79: from storage DS-d436e68e-8146-469b-bc77-2fc3049914b6 node DatanodeRegistration(127.0.0.1:41179, datanodeUuid=8e6892bb-bfc6-4873-8e37-4b5c8104cb51, infoPort=34171, infoSecurePort=0, ipcPort=33971, storageInfo=lv=-57;cid=testClusterID;nsid=831635763;c=1691733488418), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:58:10,417 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xba88dd89648d6019: Processing first storage report for DS-fcc51dc0-f9f2-4d72-ba41-22918e4df58d from datanode 686fcc46-bbd8-4850-b17d-dc366d189a2f 2023-08-11 05:58:10,417 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xba88dd89648d6019: from storage DS-fcc51dc0-f9f2-4d72-ba41-22918e4df58d node DatanodeRegistration(127.0.0.1:38593, datanodeUuid=686fcc46-bbd8-4850-b17d-dc366d189a2f, infoPort=39779, infoSecurePort=0, ipcPort=42097, storageInfo=lv=-57;cid=testClusterID;nsid=831635763;c=1691733488418), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:58:10,491 DEBUG [Listener at localhost/33971] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca 2023-08-11 05:58:10,571 INFO [Listener at localhost/33971] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/zookeeper_0, clientPort=62520, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-11 05:58:10,585 INFO [Listener at localhost/33971] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62520 2023-08-11 05:58:10,597 INFO [Listener at localhost/33971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:10,600 INFO [Listener at localhost/33971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:11,274 INFO [Listener at localhost/33971] util.FSUtils(471): Created version file at hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032 with version=8 2023-08-11 05:58:11,275 INFO [Listener at localhost/33971] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/hbase-staging 2023-08-11 05:58:11,596 INFO [Listener at localhost/33971] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-08-11 05:58:12,081 INFO [Listener at localhost/33971] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 05:58:12,113 INFO [Listener at localhost/33971] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:58:12,113 INFO [Listener at localhost/33971] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 05:58:12,114 INFO [Listener at localhost/33971] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 05:58:12,114 INFO [Listener at localhost/33971] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:58:12,114 INFO [Listener at localhost/33971] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 05:58:12,257 INFO [Listener at localhost/33971] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 05:58:12,329 DEBUG [Listener at localhost/33971] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-08-11 05:58:12,424 INFO [Listener at localhost/33971] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40419 2023-08-11 05:58:12,433 INFO [Listener at localhost/33971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:12,435 INFO [Listener at localhost/33971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:12,456 INFO [Listener at localhost/33971] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40419 connecting to ZooKeeper ensemble=127.0.0.1:62520 2023-08-11 05:58:12,496 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:404190x0, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 05:58:12,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40419-0x101f29afe790000 connected 2023-08-11 05:58:12,520 DEBUG [Listener at localhost/33971] zookeeper.ZKUtil(164): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 05:58:12,521 DEBUG [Listener at localhost/33971] zookeeper.ZKUtil(164): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:58:12,524 DEBUG [Listener at localhost/33971] zookeeper.ZKUtil(164): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 05:58:12,532 DEBUG [Listener at localhost/33971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40419 2023-08-11 05:58:12,533 DEBUG [Listener at localhost/33971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40419 2023-08-11 05:58:12,534 DEBUG [Listener at localhost/33971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40419 2023-08-11 05:58:12,534 DEBUG [Listener at localhost/33971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40419 2023-08-11 05:58:12,534 DEBUG [Listener at localhost/33971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40419 2023-08-11 05:58:12,540 INFO [Listener at localhost/33971] master.HMaster(444): hbase.rootdir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032, hbase.cluster.distributed=false 2023-08-11 05:58:12,609 INFO [Listener at localhost/33971] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 05:58:12,609 INFO [Listener at localhost/33971] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:58:12,609 INFO [Listener at localhost/33971] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 05:58:12,610 INFO [Listener at localhost/33971] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 05:58:12,610 INFO [Listener at localhost/33971] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:58:12,610 INFO [Listener at localhost/33971] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 05:58:12,615 INFO [Listener at localhost/33971] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 05:58:12,617 INFO [Listener at localhost/33971] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43767 2023-08-11 05:58:12,620 INFO [Listener at localhost/33971] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-11 05:58:12,626 DEBUG [Listener at localhost/33971] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-11 05:58:12,627 INFO [Listener at localhost/33971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:12,629 INFO [Listener at localhost/33971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:12,631 INFO [Listener at localhost/33971] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43767 connecting to ZooKeeper ensemble=127.0.0.1:62520 2023-08-11 05:58:12,634 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): regionserver:437670x0, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 05:58:12,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43767-0x101f29afe790001 connected 2023-08-11 05:58:12,635 DEBUG [Listener at localhost/33971] zookeeper.ZKUtil(164): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 05:58:12,637 DEBUG [Listener at localhost/33971] zookeeper.ZKUtil(164): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:58:12,638 DEBUG [Listener at localhost/33971] zookeeper.ZKUtil(164): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 05:58:12,638 DEBUG [Listener at localhost/33971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43767 2023-08-11 05:58:12,638 DEBUG [Listener at localhost/33971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43767 2023-08-11 05:58:12,639 DEBUG [Listener at localhost/33971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43767 2023-08-11 05:58:12,640 DEBUG [Listener at localhost/33971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43767 2023-08-11 05:58:12,640 DEBUG [Listener at localhost/33971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43767 2023-08-11 05:58:12,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40419,1691733491429 2023-08-11 05:58:12,651 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 05:58:12,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40419,1691733491429 2023-08-11 05:58:12,672 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 05:58:12,672 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 05:58:12,672 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:12,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 05:58:12,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40419,1691733491429 from backup master directory 2023-08-11 05:58:12,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 05:58:12,677 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40419,1691733491429 2023-08-11 05:58:12,677 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 05:58:12,678 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 05:58:12,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40419,1691733491429 2023-08-11 05:58:12,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-08-11 05:58:12,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-08-11 05:58:12,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/hbase.id with ID: 685e3b50-998a-448b-83ff-e236d0245e54 2023-08-11 05:58:12,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:12,826 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:12,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1fb7b4c5 to 127.0.0.1:62520 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 05:58:12,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3599d4dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 05:58:12,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 05:58:12,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-11 05:58:12,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:58:12,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/data/master/store-tmp 2023-08-11 05:58:13,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:13,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 05:58:13,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:58:13,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:58:13,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 05:58:13,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:58:13,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:58:13,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 05:58:13,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/WALs/jenkins-hbase4.apache.org,40419,1691733491429 2023-08-11 05:58:13,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40419%2C1691733491429, suffix=, logDir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/WALs/jenkins-hbase4.apache.org,40419,1691733491429, archiveDir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/oldWALs, maxLogs=10 2023-08-11 05:58:13,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-08-11 05:58:13,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-08-11 05:58:13,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:53) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:190) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:719) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:128) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:881) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:574) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:515) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:160) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:295) at org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:200) at org.apache.hadoop.hbase.master.region.MasterRegion.bootstrap(MasterRegion.java:220) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:348) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:13,105 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:417) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:13,106 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38593,DS-b54ae1f7-8526-4bc8-be8e-ae4c2f4171c3,DISK] 2023-08-11 05:58:13,106 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41179,DS-e570ef3c-b298-4a8a-a766-c4286204eee8,DISK] 2023-08-11 05:58:13,114 DEBUG [RS-EventLoopGroup-3-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:13,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/WALs/jenkins-hbase4.apache.org,40419,1691733491429/jenkins-hbase4.apache.org%2C40419%2C1691733491429.1691733493033 2023-08-11 05:58:13,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38593,DS-b54ae1f7-8526-4bc8-be8e-ae4c2f4171c3,DISK], DatanodeInfoWithStorage[127.0.0.1:41179,DS-e570ef3c-b298-4a8a-a766-c4286204eee8,DISK]] 2023-08-11 05:58:13,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:58:13,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:13,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:58:13,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:58:13,247 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:58:13,254 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-11 05:58:13,277 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-11 05:58:13,289 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:13,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:58:13,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:58:13,313 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:58:13,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:58:13,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=850521, jitterRate=0.08149446547031403}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:58:13,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 05:58:13,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-11 05:58:13,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-11 05:58:13,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-11 05:58:13,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-11 05:58:13,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-08-11 05:58:13,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 31 msec 2023-08-11 05:58:13,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-11 05:58:13,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-11 05:58:13,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-11 05:58:13,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-11 05:58:13,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-11 05:58:13,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-11 05:58:13,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-11 05:58:13,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-11 05:58:13,448 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:13,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-11 05:58:13,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-11 05:58:13,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-11 05:58:13,465 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 05:58:13,465 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 05:58:13,466 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:13,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40419,1691733491429, sessionid=0x101f29afe790000, setting cluster-up flag (Was=false) 2023-08-11 05:58:13,481 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:13,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-11 05:58:13,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40419,1691733491429 2023-08-11 05:58:13,499 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:13,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-11 05:58:13,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40419,1691733491429 2023-08-11 05:58:13,508 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/.hbase-snapshot/.tmp 2023-08-11 05:58:13,544 INFO [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(951): ClusterId : 685e3b50-998a-448b-83ff-e236d0245e54 2023-08-11 05:58:13,550 DEBUG [RS:0;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-11 05:58:13,556 DEBUG [RS:0;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-11 05:58:13,556 DEBUG [RS:0;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-11 05:58:13,561 DEBUG [RS:0;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-11 05:58:13,562 DEBUG [RS:0;jenkins-hbase4:43767] zookeeper.ReadOnlyZKClient(139): Connect 0x23e5a59b to 127.0.0.1:62520 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 05:58:13,566 DEBUG [RS:0;jenkins-hbase4:43767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d225f97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 05:58:13,567 DEBUG [RS:0;jenkins-hbase4:43767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@291dceeb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 05:58:13,600 DEBUG [RS:0;jenkins-hbase4:43767] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43767 2023-08-11 05:58:13,605 INFO [RS:0;jenkins-hbase4:43767] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-11 05:58:13,605 INFO [RS:0;jenkins-hbase4:43767] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-11 05:58:13,605 DEBUG [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1022): About to register with Master. 2023-08-11 05:58:13,609 INFO [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40419,1691733491429 with isa=jenkins-hbase4.apache.org/172.31.14.131:43767, startcode=1691733492608 2023-08-11 05:58:13,630 DEBUG [RS:0;jenkins-hbase4:43767] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-11 05:58:13,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-11 05:58:13,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:58:13,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:58:13,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:58:13,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:58:13,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-11 05:58:13,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:13,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 05:58:13,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:13,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1691733523665 2023-08-11 05:58:13,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-11 05:58:13,671 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 05:58:13,672 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-11 05:58:13,678 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 05:58:13,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-11 05:58:13,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-11 05:58:13,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-11 05:58:13,693 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55295, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-08-11 05:58:13,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-11 05:58:13,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-11 05:58:13,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:13,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-11 05:58:13,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-11 05:58:13,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-11 05:58:13,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-11 05:58:13,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-11 05:58:13,704 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40419] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 05:58:13,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691733493705,5,FailOnTimeoutGroup] 2023-08-11 05:58:13,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691733493706,5,FailOnTimeoutGroup] 2023-08-11 05:58:13,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:13,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-11 05:58:13,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:13,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:13,734 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 05:58:13,735 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 05:58:13,735 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032 2023-08-11 05:58:13,754 DEBUG [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(2830): Master is not running yet 2023-08-11 05:58:13,754 WARN [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-08-11 05:58:13,757 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:13,759 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 05:58:13,762 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/info 2023-08-11 05:58:13,762 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 05:58:13,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:13,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 05:58:13,767 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/rep_barrier 2023-08-11 05:58:13,768 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 05:58:13,769 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:13,769 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 05:58:13,771 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/table 2023-08-11 05:58:13,772 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 05:58:13,773 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:13,775 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740 2023-08-11 05:58:13,776 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740 2023-08-11 05:58:13,780 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 05:58:13,782 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 05:58:13,785 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:58:13,786 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=845164, jitterRate=0.07468202710151672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 05:58:13,787 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 05:58:13,787 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 05:58:13,787 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 05:58:13,787 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 05:58:13,787 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 05:58:13,787 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 05:58:13,788 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 05:58:13,788 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 05:58:13,793 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 05:58:13,793 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-11 05:58:13,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-11 05:58:13,813 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-11 05:58:13,815 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-11 05:58:13,856 INFO [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40419,1691733491429 with isa=jenkins-hbase4.apache.org/172.31.14.131:43767, startcode=1691733492608 2023-08-11 05:58:13,861 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40419] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:13,867 DEBUG [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032 2023-08-11 05:58:13,867 DEBUG [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36289 2023-08-11 05:58:13,867 DEBUG [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-11 05:58:13,872 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 05:58:13,873 DEBUG [RS:0;jenkins-hbase4:43767] zookeeper.ZKUtil(162): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:13,873 WARN [RS:0;jenkins-hbase4:43767] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 05:58:13,873 INFO [RS:0;jenkins-hbase4:43767] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:58:13,874 DEBUG [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:13,874 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43767,1691733492608] 2023-08-11 05:58:13,882 DEBUG [RS:0;jenkins-hbase4:43767] zookeeper.ZKUtil(162): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:13,896 DEBUG [RS:0;jenkins-hbase4:43767] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-11 05:58:13,906 INFO [RS:0;jenkins-hbase4:43767] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-11 05:58:13,927 INFO [RS:0;jenkins-hbase4:43767] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-11 05:58:13,930 INFO [RS:0;jenkins-hbase4:43767] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-11 05:58:13,931 INFO [RS:0;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:13,932 INFO [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-11 05:58:13,938 INFO [RS:0;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:13,939 DEBUG [RS:0;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:13,939 DEBUG [RS:0;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:13,939 DEBUG [RS:0;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:13,939 DEBUG [RS:0;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:13,939 DEBUG [RS:0;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:13,939 DEBUG [RS:0;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 05:58:13,940 DEBUG [RS:0;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:13,940 DEBUG [RS:0;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:13,940 DEBUG [RS:0;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:13,940 DEBUG [RS:0;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:13,941 INFO [RS:0;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:13,941 INFO [RS:0;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:13,941 INFO [RS:0;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:13,958 INFO [RS:0;jenkins-hbase4:43767] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-11 05:58:13,960 INFO [RS:0;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43767,1691733492608-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:13,968 DEBUG [jenkins-hbase4:40419] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-11 05:58:13,970 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43767,1691733492608, state=OPENING 2023-08-11 05:58:13,977 INFO [RS:0;jenkins-hbase4:43767] regionserver.Replication(203): jenkins-hbase4.apache.org,43767,1691733492608 started 2023-08-11 05:58:13,977 INFO [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43767,1691733492608, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43767, sessionid=0x101f29afe790001 2023-08-11 05:58:13,977 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-11 05:58:13,977 DEBUG [RS:0;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-11 05:58:13,977 DEBUG [RS:0;jenkins-hbase4:43767] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:13,978 DEBUG [RS:0;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43767,1691733492608' 2023-08-11 05:58:13,978 DEBUG [RS:0;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:58:13,979 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:13,979 DEBUG [RS:0;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:58:13,980 DEBUG [RS:0;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-11 05:58:13,980 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 05:58:13,980 DEBUG [RS:0;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-11 05:58:13,980 DEBUG [RS:0;jenkins-hbase4:43767] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:13,980 DEBUG [RS:0;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43767,1691733492608' 2023-08-11 05:58:13,980 DEBUG [RS:0;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-11 05:58:13,981 DEBUG [RS:0;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-11 05:58:13,981 DEBUG [RS:0;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-11 05:58:13,981 INFO [RS:0;jenkins-hbase4:43767] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-11 05:58:13,981 INFO [RS:0;jenkins-hbase4:43767] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-11 05:58:13,983 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43767,1691733492608}] 2023-08-11 05:58:14,092 INFO [RS:0;jenkins-hbase4:43767] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43767%2C1691733492608, suffix=, logDir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608, archiveDir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/oldWALs, maxLogs=32 2023-08-11 05:58:14,111 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41179,DS-e570ef3c-b298-4a8a-a766-c4286204eee8,DISK] 2023-08-11 05:58:14,111 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38593,DS-b54ae1f7-8526-4bc8-be8e-ae4c2f4171c3,DISK] 2023-08-11 05:58:14,115 INFO [RS:0;jenkins-hbase4:43767] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.1691733494094 2023-08-11 05:58:14,115 DEBUG [RS:0;jenkins-hbase4:43767] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41179,DS-e570ef3c-b298-4a8a-a766-c4286204eee8,DISK], DatanodeInfoWithStorage[127.0.0.1:38593,DS-b54ae1f7-8526-4bc8-be8e-ae4c2f4171c3,DISK]] 2023-08-11 05:58:14,165 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:14,168 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-11 05:58:14,171 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-11 05:58:14,183 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-11 05:58:14,184 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:58:14,187 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta, suffix=.meta, logDir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608, archiveDir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/oldWALs, maxLogs=32 2023-08-11 05:58:14,203 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38593,DS-b54ae1f7-8526-4bc8-be8e-ae4c2f4171c3,DISK] 2023-08-11 05:58:14,203 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41179,DS-e570ef3c-b298-4a8a-a766-c4286204eee8,DISK] 2023-08-11 05:58:14,207 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta.1691733494188.meta 2023-08-11 05:58:14,208 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38593,DS-b54ae1f7-8526-4bc8-be8e-ae4c2f4171c3,DISK], DatanodeInfoWithStorage[127.0.0.1:41179,DS-e570ef3c-b298-4a8a-a766-c4286204eee8,DISK]] 2023-08-11 05:58:14,208 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:58:14,209 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-11 05:58:14,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-11 05:58:14,231 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-11 05:58:14,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-11 05:58:14,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:14,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-11 05:58:14,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-11 05:58:14,241 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 05:58:14,242 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/info 2023-08-11 05:58:14,242 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/info 2023-08-11 05:58:14,243 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 05:58:14,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:14,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 05:58:14,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/rep_barrier 2023-08-11 05:58:14,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/rep_barrier 2023-08-11 05:58:14,246 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 05:58:14,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:14,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 05:58:14,248 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/table 2023-08-11 05:58:14,249 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/table 2023-08-11 05:58:14,249 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 05:58:14,250 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:14,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740 2023-08-11 05:58:14,254 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740 2023-08-11 05:58:14,257 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 05:58:14,260 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 05:58:14,261 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=718785, jitterRate=-0.08601804077625275}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 05:58:14,261 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 05:58:14,271 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1691733494158 2023-08-11 05:58:14,290 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-11 05:58:14,291 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-11 05:58:14,291 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43767,1691733492608, state=OPEN 2023-08-11 05:58:14,295 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-11 05:58:14,295 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 05:58:14,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-11 05:58:14,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43767,1691733492608 in 312 msec 2023-08-11 05:58:14,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-11 05:58:14,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 500 msec 2023-08-11 05:58:14,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 757 msec 2023-08-11 05:58:14,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1691733494311, completionTime=-1 2023-08-11 05:58:14,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-11 05:58:14,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-11 05:58:14,374 DEBUG [hconnection-0x34dc9717-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 05:58:14,377 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 05:58:14,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-11 05:58:14,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1691733554393 2023-08-11 05:58:14,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1691733614393 2023-08-11 05:58:14,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 81 msec 2023-08-11 05:58:14,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40419,1691733491429-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:14,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40419,1691733491429-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:14,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40419,1691733491429-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:14,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40419, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:14,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:14,424 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-11 05:58:14,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-11 05:58:14,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 05:58:14,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-11 05:58:14,446 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 05:58:14,448 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 05:58:14,470 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/.tmp/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e 2023-08-11 05:58:14,472 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/.tmp/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e empty. 2023-08-11 05:58:14,473 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/.tmp/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e 2023-08-11 05:58:14,473 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-11 05:58:14,500 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-11 05:58:14,502 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => ffed363077baed9ff10d520a7b023c1e, NAME => 'hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/.tmp 2023-08-11 05:58:14,517 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:14,517 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing ffed363077baed9ff10d520a7b023c1e, disabling compactions & flushes 2023-08-11 05:58:14,517 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. 2023-08-11 05:58:14,517 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. 2023-08-11 05:58:14,517 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. after waiting 0 ms 2023-08-11 05:58:14,517 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. 2023-08-11 05:58:14,517 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. 2023-08-11 05:58:14,517 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for ffed363077baed9ff10d520a7b023c1e: 2023-08-11 05:58:14,522 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 05:58:14,537 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691733494524"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691733494524"}]},"ts":"1691733494524"} 2023-08-11 05:58:14,564 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 05:58:14,566 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 05:58:14,570 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733494566"}]},"ts":"1691733494566"} 2023-08-11 05:58:14,575 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-11 05:58:14,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ffed363077baed9ff10d520a7b023c1e, ASSIGN}] 2023-08-11 05:58:14,587 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ffed363077baed9ff10d520a7b023c1e, ASSIGN 2023-08-11 05:58:14,589 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ffed363077baed9ff10d520a7b023c1e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43767,1691733492608; forceNewPlan=false, retain=false 2023-08-11 05:58:14,740 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ffed363077baed9ff10d520a7b023c1e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:14,741 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691733494740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691733494740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691733494740"}]},"ts":"1691733494740"} 2023-08-11 05:58:14,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ffed363077baed9ff10d520a7b023c1e, server=jenkins-hbase4.apache.org,43767,1691733492608}] 2023-08-11 05:58:14,907 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. 2023-08-11 05:58:14,909 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ffed363077baed9ff10d520a7b023c1e, NAME => 'hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e.', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:58:14,910 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ffed363077baed9ff10d520a7b023c1e 2023-08-11 05:58:14,910 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:14,911 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ffed363077baed9ff10d520a7b023c1e 2023-08-11 05:58:14,911 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ffed363077baed9ff10d520a7b023c1e 2023-08-11 05:58:14,912 INFO [StoreOpener-ffed363077baed9ff10d520a7b023c1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ffed363077baed9ff10d520a7b023c1e 2023-08-11 05:58:14,915 DEBUG [StoreOpener-ffed363077baed9ff10d520a7b023c1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e/info 2023-08-11 05:58:14,915 DEBUG [StoreOpener-ffed363077baed9ff10d520a7b023c1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e/info 2023-08-11 05:58:14,915 INFO [StoreOpener-ffed363077baed9ff10d520a7b023c1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffed363077baed9ff10d520a7b023c1e columnFamilyName info 2023-08-11 05:58:14,916 INFO [StoreOpener-ffed363077baed9ff10d520a7b023c1e-1] regionserver.HStore(310): Store=ffed363077baed9ff10d520a7b023c1e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:14,918 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e 2023-08-11 05:58:14,918 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e 2023-08-11 05:58:14,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ffed363077baed9ff10d520a7b023c1e 2023-08-11 05:58:14,927 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:58:14,928 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ffed363077baed9ff10d520a7b023c1e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=842656, jitterRate=0.07149307429790497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:58:14,928 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ffed363077baed9ff10d520a7b023c1e: 2023-08-11 05:58:14,930 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e., pid=6, masterSystemTime=1691733494900 2023-08-11 05:58:14,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. 2023-08-11 05:58:14,934 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. 2023-08-11 05:58:14,935 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ffed363077baed9ff10d520a7b023c1e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:14,935 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691733494934"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691733494934"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691733494934"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691733494934"}]},"ts":"1691733494934"} 2023-08-11 05:58:14,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-11 05:58:14,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ffed363077baed9ff10d520a7b023c1e, server=jenkins-hbase4.apache.org,43767,1691733492608 in 192 msec 2023-08-11 05:58:14,946 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-11 05:58:14,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ffed363077baed9ff10d520a7b023c1e, ASSIGN in 357 msec 2023-08-11 05:58:14,948 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 05:58:14,948 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733494948"}]},"ts":"1691733494948"} 2023-08-11 05:58:14,951 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-11 05:58:14,954 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 05:58:14,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 519 msec 2023-08-11 05:58:15,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-11 05:58:15,048 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-11 05:58:15,048 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:15,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-11 05:58:15,101 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 05:58:15,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-08-11 05:58:15,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-11 05:58:15,130 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 05:58:15,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-08-11 05:58:15,145 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-11 05:58:15,147 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-11 05:58:15,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.468sec 2023-08-11 05:58:15,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-11 05:58:15,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-11 05:58:15,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-11 05:58:15,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40419,1691733491429-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-11 05:58:15,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40419,1691733491429-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-11 05:58:15,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-11 05:58:15,250 DEBUG [Listener at localhost/33971] zookeeper.ReadOnlyZKClient(139): Connect 0x32038b2b to 127.0.0.1:62520 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 05:58:15,256 DEBUG [Listener at localhost/33971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47551c5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 05:58:15,297 DEBUG [hconnection-0x6670472b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 05:58:15,308 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 05:58:15,318 INFO [Listener at localhost/33971] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40419,1691733491429 2023-08-11 05:58:15,319 INFO [Listener at localhost/33971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:15,326 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-11 05:58:15,326 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:15,328 INFO [Listener at localhost/33971] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-11 05:58:15,340 WARN [Listener at localhost/33971] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 05:58:15,343 WARN [Listener at localhost/33971] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:58:15,345 INFO [Listener at localhost/33971] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:58:15,351 INFO [Listener at localhost/33971] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/java.io.tmpdir/Jetty_localhost_38163_datanode____phdnyo/webapp 2023-08-11 05:58:15,468 INFO [Listener at localhost/33971] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38163 2023-08-11 05:58:15,478 WARN [Listener at localhost/37333] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:58:15,503 WARN [Listener at localhost/37333] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 05:58:15,507 WARN [Listener at localhost/37333] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:58:15,509 INFO [Listener at localhost/37333] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:58:15,514 INFO [Listener at localhost/37333] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/java.io.tmpdir/Jetty_localhost_37873_datanode____.d03dux/webapp 2023-08-11 05:58:15,596 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2c64314b8c6bd770: Processing first storage report for DS-625cf342-57ed-4287-92c8-ad7259fd69ea from datanode a0e02ea1-c550-43aa-ab04-34f9f5c55748 2023-08-11 05:58:15,596 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2c64314b8c6bd770: from storage DS-625cf342-57ed-4287-92c8-ad7259fd69ea node DatanodeRegistration(127.0.0.1:41805, datanodeUuid=a0e02ea1-c550-43aa-ab04-34f9f5c55748, infoPort=40807, infoSecurePort=0, ipcPort=37333, storageInfo=lv=-57;cid=testClusterID;nsid=831635763;c=1691733488418), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:58:15,596 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2c64314b8c6bd770: Processing first storage report for DS-c931fcc8-0c83-4f02-8568-873eafa6ff69 from datanode a0e02ea1-c550-43aa-ab04-34f9f5c55748 2023-08-11 05:58:15,596 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2c64314b8c6bd770: from storage DS-c931fcc8-0c83-4f02-8568-873eafa6ff69 node DatanodeRegistration(127.0.0.1:41805, datanodeUuid=a0e02ea1-c550-43aa-ab04-34f9f5c55748, infoPort=40807, infoSecurePort=0, ipcPort=37333, storageInfo=lv=-57;cid=testClusterID;nsid=831635763;c=1691733488418), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:58:15,631 INFO [Listener at localhost/37333] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37873 2023-08-11 05:58:15,642 WARN [Listener at localhost/34037] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:58:15,667 WARN [Listener at localhost/34037] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 05:58:15,671 WARN [Listener at localhost/34037] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:58:15,673 INFO [Listener at localhost/34037] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:58:15,679 INFO [Listener at localhost/34037] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/java.io.tmpdir/Jetty_localhost_41663_datanode____ij9lfh/webapp 2023-08-11 05:58:15,789 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfb580474dfff3340: Processing first storage report for DS-e9b1b670-c1e1-4781-ac38-f124bc598c1e from datanode 95a65231-7ff1-4088-bab7-ce571c2fc3d9 2023-08-11 05:58:15,789 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfb580474dfff3340: from storage DS-e9b1b670-c1e1-4781-ac38-f124bc598c1e node DatanodeRegistration(127.0.0.1:35185, datanodeUuid=95a65231-7ff1-4088-bab7-ce571c2fc3d9, infoPort=33169, infoSecurePort=0, ipcPort=34037, storageInfo=lv=-57;cid=testClusterID;nsid=831635763;c=1691733488418), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-11 05:58:15,790 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfb580474dfff3340: Processing first storage report for DS-0ed87d6f-f4ad-4510-8a12-efde9bae4766 from datanode 95a65231-7ff1-4088-bab7-ce571c2fc3d9 2023-08-11 05:58:15,790 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfb580474dfff3340: from storage DS-0ed87d6f-f4ad-4510-8a12-efde9bae4766 node DatanodeRegistration(127.0.0.1:35185, datanodeUuid=95a65231-7ff1-4088-bab7-ce571c2fc3d9, infoPort=33169, infoSecurePort=0, ipcPort=34037, storageInfo=lv=-57;cid=testClusterID;nsid=831635763;c=1691733488418), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:58:15,825 INFO [Listener at localhost/34037] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41663 2023-08-11 05:58:15,838 WARN [Listener at localhost/45851] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:58:15,937 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc3143cdbd86deffb: Processing first storage report for DS-92cb5a45-a1a0-41f1-8aaa-587a5ad9ba3e from datanode 1efe9024-ae3c-496d-9c01-1c413a6829ee 2023-08-11 05:58:15,937 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc3143cdbd86deffb: from storage DS-92cb5a45-a1a0-41f1-8aaa-587a5ad9ba3e node DatanodeRegistration(127.0.0.1:34351, datanodeUuid=1efe9024-ae3c-496d-9c01-1c413a6829ee, infoPort=34641, infoSecurePort=0, ipcPort=45851, storageInfo=lv=-57;cid=testClusterID;nsid=831635763;c=1691733488418), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:58:15,937 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc3143cdbd86deffb: Processing first storage report for DS-bf99c837-40b4-498d-9c06-667f04c52860 from datanode 1efe9024-ae3c-496d-9c01-1c413a6829ee 2023-08-11 05:58:15,937 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc3143cdbd86deffb: from storage DS-bf99c837-40b4-498d-9c06-667f04c52860 node DatanodeRegistration(127.0.0.1:34351, datanodeUuid=1efe9024-ae3c-496d-9c01-1c413a6829ee, infoPort=34641, infoSecurePort=0, ipcPort=45851, storageInfo=lv=-57;cid=testClusterID;nsid=831635763;c=1691733488418), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-11 05:58:15,958 DEBUG [Listener at localhost/45851] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-11 05:58:15,961 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-11 05:58:15,969 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40419] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-11 05:58:15,969 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40419] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-11 05:58:15,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40419] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 05:58:15,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40419] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath 2023-08-11 05:58:15,977 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 05:58:15,979 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 05:58:15,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40419] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRollOnDatanodeDeath" procId is: 9 2023-08-11 05:58:15,982 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8 2023-08-11 05:58:15,984 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8 empty. 2023-08-11 05:58:15,985 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8 2023-08-11 05:58:15,986 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRollOnDatanodeDeath regions 2023-08-11 05:58:15,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40419] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-11 05:58:16,006 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/.tabledesc/.tableinfo.0000000001 2023-08-11 05:58:16,008 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8eda453f4c83aa112679dc1a9f17c3d8, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/.tmp 2023-08-11 05:58:16,025 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:16,025 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1604): Closing 8eda453f4c83aa112679dc1a9f17c3d8, disabling compactions & flushes 2023-08-11 05:58:16,025 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:16,025 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:16,025 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. after waiting 0 ms 2023-08-11 05:58:16,025 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:16,025 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:16,025 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1558): Region close journal for 8eda453f4c83aa112679dc1a9f17c3d8: 2023-08-11 05:58:16,030 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 05:58:16,032 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1691733496031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691733496031"}]},"ts":"1691733496031"} 2023-08-11 05:58:16,034 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 05:58:16,036 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 05:58:16,036 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733496036"}]},"ts":"1691733496036"} 2023-08-11 05:58:16,038 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLING in hbase:meta 2023-08-11 05:58:16,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=8eda453f4c83aa112679dc1a9f17c3d8, ASSIGN}] 2023-08-11 05:58:16,045 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=8eda453f4c83aa112679dc1a9f17c3d8, ASSIGN 2023-08-11 05:58:16,046 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=8eda453f4c83aa112679dc1a9f17c3d8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43767,1691733492608; forceNewPlan=false, retain=false 2023-08-11 05:58:16,198 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8eda453f4c83aa112679dc1a9f17c3d8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:16,198 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1691733496198"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691733496198"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691733496198"}]},"ts":"1691733496198"} 2023-08-11 05:58:16,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 8eda453f4c83aa112679dc1a9f17c3d8, server=jenkins-hbase4.apache.org,43767,1691733492608}] 2023-08-11 05:58:16,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:16,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8eda453f4c83aa112679dc1a9f17c3d8, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8.', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:58:16,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRollOnDatanodeDeath 8eda453f4c83aa112679dc1a9f17c3d8 2023-08-11 05:58:16,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:16,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8eda453f4c83aa112679dc1a9f17c3d8 2023-08-11 05:58:16,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8eda453f4c83aa112679dc1a9f17c3d8 2023-08-11 05:58:16,364 INFO [StoreOpener-8eda453f4c83aa112679dc1a9f17c3d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8eda453f4c83aa112679dc1a9f17c3d8 2023-08-11 05:58:16,366 DEBUG [StoreOpener-8eda453f4c83aa112679dc1a9f17c3d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8/info 2023-08-11 05:58:16,366 DEBUG [StoreOpener-8eda453f4c83aa112679dc1a9f17c3d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8/info 2023-08-11 05:58:16,367 INFO [StoreOpener-8eda453f4c83aa112679dc1a9f17c3d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8eda453f4c83aa112679dc1a9f17c3d8 columnFamilyName info 2023-08-11 05:58:16,367 INFO [StoreOpener-8eda453f4c83aa112679dc1a9f17c3d8-1] regionserver.HStore(310): Store=8eda453f4c83aa112679dc1a9f17c3d8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:16,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8 2023-08-11 05:58:16,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8 2023-08-11 05:58:16,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8eda453f4c83aa112679dc1a9f17c3d8 2023-08-11 05:58:16,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:58:16,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8eda453f4c83aa112679dc1a9f17c3d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=804998, jitterRate=0.023608893156051636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:58:16,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8eda453f4c83aa112679dc1a9f17c3d8: 2023-08-11 05:58:16,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8., pid=11, masterSystemTime=1691733496355 2023-08-11 05:58:16,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:16,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:16,383 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8eda453f4c83aa112679dc1a9f17c3d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:16,384 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1691733496383"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691733496383"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691733496383"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691733496383"}]},"ts":"1691733496383"} 2023-08-11 05:58:16,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-11 05:58:16,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 8eda453f4c83aa112679dc1a9f17c3d8, server=jenkins-hbase4.apache.org,43767,1691733492608 in 185 msec 2023-08-11 05:58:16,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-11 05:58:16,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=8eda453f4c83aa112679dc1a9f17c3d8, ASSIGN in 346 msec 2023-08-11 05:58:16,394 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 05:58:16,395 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733496394"}]},"ts":"1691733496394"} 2023-08-11 05:58:16,397 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLED in hbase:meta 2023-08-11 05:58:16,400 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 05:58:16,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath in 427 msec 2023-08-11 05:58:19,750 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-11 05:58:19,903 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-11 05:58:19,905 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-11 05:58:19,905 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRollOnDatanodeDeath' 2023-08-11 05:58:21,590 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 05:58:21,591 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-08-11 05:58:25,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40419] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-11 05:58:25,998 INFO [Listener at localhost/45851] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRollOnDatanodeDeath, procId: 9 completed 2023-08-11 05:58:25,998 DEBUG [Listener at localhost/45851] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestLogRolling-testLogRollOnDatanodeDeath get assigned. Timeout = 60000ms 2023-08-11 05:58:25,999 INFO [Listener at localhost/45851] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-08-11 05:58:26,003 INFO [Listener at localhost/45851] hbase.HBaseTestingUtility(3484): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned to meta. Checking AM states. 2023-08-11 05:58:26,004 INFO [Listener at localhost/45851] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-08-11 05:58:26,004 INFO [Listener at localhost/45851] hbase.HBaseTestingUtility(3504): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned. 2023-08-11 05:58:26,014 DEBUG [Listener at localhost/45851] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRollOnDatanodeDeath 2023-08-11 05:58:26,015 DEBUG [Listener at localhost/45851] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:26,016 WARN [Listener at localhost/45851] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 05:58:26,019 INFO [Listener at localhost/45851] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:58:26,023 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-394533367_17 at /127.0.0.1:34480 [Receiving block BP-1158019010-172.31.14.131-1691733488418:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:38593:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:34480 dst: /127.0.0.1:38593 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,023 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-394533367_17 at /127.0.0.1:34490 [Receiving block BP-1158019010-172.31.14.131-1691733488418:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:38593:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:34490 dst: /127.0.0.1:38593 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,023 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_776164554_17 at /127.0.0.1:34442 [Receiving block BP-1158019010-172.31.14.131-1691733488418:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:38593:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:34442 dst: /127.0.0.1:38593 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,122 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-394533367_17 at /127.0.0.1:60976 [Receiving block BP-1158019010-172.31.14.131-1691733488418:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:41179:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:60976 dst: /127.0.0.1:41179 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,124 WARN [BP-1158019010-172.31.14.131-1691733488418 heartbeating to localhost/127.0.0.1:36289] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 05:58:26,124 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_776164554_17 at /127.0.0.1:60958 [Receiving block BP-1158019010-172.31.14.131-1691733488418:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:41179:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:60958 dst: /127.0.0.1:41179 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,123 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-394533367_17 at /127.0.0.1:60980 [Receiving block BP-1158019010-172.31.14.131-1691733488418:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:41179:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:60980 dst: /127.0.0.1:41179 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,124 WARN [BP-1158019010-172.31.14.131-1691733488418 heartbeating to localhost/127.0.0.1:36289] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1158019010-172.31.14.131-1691733488418 (Datanode Uuid 8e6892bb-bfc6-4873-8e37-4b5c8104cb51) service to localhost/127.0.0.1:36289 2023-08-11 05:58:26,127 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/dfs/data/data3/current/BP-1158019010-172.31.14.131-1691733488418] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:58:26,127 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/dfs/data/data4/current/BP-1158019010-172.31.14.131-1691733488418] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:58:26,134 WARN [Listener at localhost/45851] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 05:58:26,137 WARN [Listener at localhost/45851] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:58:26,138 INFO [Listener at localhost/45851] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:58:26,142 INFO [Listener at localhost/45851] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/java.io.tmpdir/Jetty_localhost_39741_datanode____.k17knf/webapp 2023-08-11 05:58:26,236 INFO [Listener at localhost/45851] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39741 2023-08-11 05:58:26,243 WARN [Listener at localhost/40135] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:58:26,247 WARN [AsyncFSWAL-0-hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032-prefix:jenkins-hbase4.apache.org,43767,1691733492608] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,249 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C43767%2C1691733492608:(num 1691733494094) roll requested 2023-08-11 05:58:26,264 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38593,DS-b54ae1f7-8526-4bc8-be8e-ae4c2f4171c3,DISK] 2023-08-11 05:58:26,264 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35185,DS-e9b1b670-c1e1-4781-ac38-f124bc598c1e,DISK] 2023-08-11 05:58:26,268 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.1691733494094 with entries=6, filesize=3.19 KB; new WAL /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.1691733506249 2023-08-11 05:58:26,268 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38593,DS-b54ae1f7-8526-4bc8-be8e-ae4c2f4171c3,DISK], DatanodeInfoWithStorage[127.0.0.1:35185,DS-e9b1b670-c1e1-4781-ac38-f124bc598c1e,DISK]] 2023-08-11 05:58:26,269 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.1691733494094 is not closed yet, will try archiving it next time 2023-08-11 05:58:26,270 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-11 05:58:26,270 INFO [Listener at localhost/40135] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-11 05:58:26,271 DEBUG [Listener at localhost/40135] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32038b2b to 127.0.0.1:62520 2023-08-11 05:58:26,271 DEBUG [Listener at localhost/40135] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:58:26,271 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,272 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,272 DEBUG [Listener at localhost/40135] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-11 05:58:26,272 DEBUG [Listener at localhost/40135] util.JVMClusterUtil(257): Found active master hash=879178813, stopped=false 2023-08-11 05:58:26,272 INFO [Listener at localhost/40135] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40419,1691733491429 2023-08-11 05:58:26,274 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.1691733494094 2023-08-11 05:58:26,275 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 05:58:26,276 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 05:58:26,276 INFO [Listener at localhost/40135] procedure2.ProcedureExecutor(629): Stopping 2023-08-11 05:58:26,276 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:26,276 DEBUG [Listener at localhost/40135] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fb7b4c5 to 127.0.0.1:62520 2023-08-11 05:58:26,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:58:26,277 DEBUG [Listener at localhost/40135] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:58:26,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:58:26,277 INFO [Listener at localhost/40135] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43767,1691733492608' ***** 2023-08-11 05:58:26,278 INFO [Listener at localhost/40135] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-11 05:58:26,278 INFO [RS:0;jenkins-hbase4:43767] regionserver.HeapMemoryManager(220): Stopping 2023-08-11 05:58:26,278 INFO [RS:0;jenkins-hbase4:43767] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-11 05:58:26,278 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-11 05:58:26,278 INFO [RS:0;jenkins-hbase4:43767] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-11 05:58:26,279 INFO [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(3305): Received CLOSE for ffed363077baed9ff10d520a7b023c1e 2023-08-11 05:58:26,280 WARN [IPC Server handler 2 on default port 36289] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.1691733494094 has not been closed. Lease recovery is in progress. RecoveryId = 1015 for block blk_1073741832_1008 2023-08-11 05:58:26,280 INFO [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(3305): Received CLOSE for 8eda453f4c83aa112679dc1a9f17c3d8 2023-08-11 05:58:26,280 INFO [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:26,281 DEBUG [RS:0;jenkins-hbase4:43767] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23e5a59b to 127.0.0.1:62520 2023-08-11 05:58:26,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ffed363077baed9ff10d520a7b023c1e, disabling compactions & flushes 2023-08-11 05:58:26,282 DEBUG [RS:0;jenkins-hbase4:43767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:58:26,283 INFO [RS:0;jenkins-hbase4:43767] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-11 05:58:26,283 INFO [RS:0;jenkins-hbase4:43767] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-11 05:58:26,283 INFO [RS:0;jenkins-hbase4:43767] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-11 05:58:26,283 INFO [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-11 05:58:26,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. 2023-08-11 05:58:26,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. 2023-08-11 05:58:26,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. after waiting 0 ms 2023-08-11 05:58:26,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. 2023-08-11 05:58:26,283 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.1691733494094 after 9ms 2023-08-11 05:58:26,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ffed363077baed9ff10d520a7b023c1e 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-11 05:58:26,284 INFO [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-08-11 05:58:26,284 DEBUG [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1478): Online Regions={ffed363077baed9ff10d520a7b023c1e=hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e., 1588230740=hbase:meta,,1.1588230740, 8eda453f4c83aa112679dc1a9f17c3d8=TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8.} 2023-08-11 05:58:26,287 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 05:58:26,288 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 05:58:26,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 05:58:26,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 05:58:26,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 05:58:26,288 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.92 KB heapSize=5.45 KB 2023-08-11 05:58:26,289 DEBUG [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1504): Waiting on 1588230740, 8eda453f4c83aa112679dc1a9f17c3d8, ffed363077baed9ff10d520a7b023c1e 2023-08-11 05:58:26,298 WARN [AsyncFSWAL-0-hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032-prefix:jenkins-hbase4.apache.org,43767,1691733492608.meta] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,299 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta:.meta(num 1691733494188) roll requested 2023-08-11 05:58:26,316 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41805,DS-625cf342-57ed-4287-92c8-ad7259fd69ea,DISK] 2023-08-11 05:58:26,316 WARN [regionserver/jenkins-hbase4:0.logRoller] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(571): create fan-out dfs output /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta.1691733506299.meta failed, retry = 0 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:41179 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,372 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9e84e12db51c4e9d: Processing first storage report for DS-e570ef3c-b298-4a8a-a766-c4286204eee8 from datanode 8e6892bb-bfc6-4873-8e37-4b5c8104cb51 2023-08-11 05:58:26,373 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9e84e12db51c4e9d: from storage DS-e570ef3c-b298-4a8a-a766-c4286204eee8 node DatanodeRegistration(127.0.0.1:40493, datanodeUuid=8e6892bb-bfc6-4873-8e37-4b5c8104cb51, infoPort=37365, infoSecurePort=0, ipcPort=40135, storageInfo=lv=-57;cid=testClusterID;nsid=831635763;c=1691733488418), blocks: 6, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-11 05:58:26,373 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9e84e12db51c4e9d: Processing first storage report for DS-d436e68e-8146-469b-bc77-2fc3049914b6 from datanode 8e6892bb-bfc6-4873-8e37-4b5c8104cb51 2023-08-11 05:58:26,374 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9e84e12db51c4e9d: from storage DS-d436e68e-8146-469b-bc77-2fc3049914b6 node DatanodeRegistration(127.0.0.1:40493, datanodeUuid=8e6892bb-bfc6-4873-8e37-4b5c8104cb51, infoPort=37365, infoSecurePort=0, ipcPort=40135, storageInfo=lv=-57;cid=testClusterID;nsid=831635763;c=1691733488418), blocks: 6, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:58:26,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e/.tmp/info/e6a06601fc254ad5972fc2a3bda69b59 2023-08-11 05:58:26,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e/.tmp/info/e6a06601fc254ad5972fc2a3bda69b59 as hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e/info/e6a06601fc254ad5972fc2a3bda69b59 2023-08-11 05:58:26,420 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-394533367_17 at /127.0.0.1:35852 [Receiving block BP-1158019010-172.31.14.131-1691733488418:blk_1073741839_1016]] datanode.DataXceiver(323): 127.0.0.1:41805:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:35852 dst: /127.0.0.1:41805 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,427 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35185,DS-e9b1b670-c1e1-4781-ac38-f124bc598c1e,DISK] 2023-08-11 05:58:26,427 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41805,DS-625cf342-57ed-4287-92c8-ad7259fd69ea,DISK] 2023-08-11 05:58:26,430 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta.1691733494188.meta with entries=12, filesize=3.87 KB; new WAL /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta.1691733506299.meta 2023-08-11 05:58:26,430 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41805,DS-625cf342-57ed-4287-92c8-ad7259fd69ea,DISK], DatanodeInfoWithStorage[127.0.0.1:35185,DS-e9b1b670-c1e1-4781-ac38-f124bc598c1e,DISK]] 2023-08-11 05:58:26,431 DEBUG [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta.1691733494188.meta is not closed yet, will try archiving it next time 2023-08-11 05:58:26,431 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,432 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:26,432 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta.1691733494188.meta 2023-08-11 05:58:26,434 WARN [IPC Server handler 1 on default port 36289] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta.1691733494188.meta has not been closed. Lease recovery is in progress. RecoveryId = 1019 for block blk_1073741833_1009 2023-08-11 05:58:26,434 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta.1691733494188.meta after 1ms 2023-08-11 05:58:26,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e/info/e6a06601fc254ad5972fc2a3bda69b59, entries=2, sequenceid=6, filesize=4.8 K 2023-08-11 05:58:26,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ffed363077baed9ff10d520a7b023c1e in 153ms, sequenceid=6, compaction requested=false 2023-08-11 05:58:26,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/namespace/ffed363077baed9ff10d520a7b023c1e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-11 05:58:26,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. 2023-08-11 05:58:26,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ffed363077baed9ff10d520a7b023c1e: 2023-08-11 05:58:26,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.69 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/.tmp/info/b8ef806a986840d6abf7ddd5084e1245 2023-08-11 05:58:26,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1691733494433.ffed363077baed9ff10d520a7b023c1e. 2023-08-11 05:58:26,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8eda453f4c83aa112679dc1a9f17c3d8, disabling compactions & flushes 2023-08-11 05:58:26,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:26,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:26,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. after waiting 0 ms 2023-08-11 05:58:26,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:26,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8eda453f4c83aa112679dc1a9f17c3d8 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-08-11 05:58:26,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8/.tmp/info/f21b2a9a4f6e442a9e32479244a125ab 2023-08-11 05:58:26,489 DEBUG [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1504): Waiting on 1588230740, 8eda453f4c83aa112679dc1a9f17c3d8 2023-08-11 05:58:26,499 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=240 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/.tmp/table/f05e29e5af7f4a08853f5881e1811929 2023-08-11 05:58:26,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8/.tmp/info/f21b2a9a4f6e442a9e32479244a125ab as hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8/info/f21b2a9a4f6e442a9e32479244a125ab 2023-08-11 05:58:26,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/.tmp/info/b8ef806a986840d6abf7ddd5084e1245 as hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/info/b8ef806a986840d6abf7ddd5084e1245 2023-08-11 05:58:26,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8/info/f21b2a9a4f6e442a9e32479244a125ab, entries=2, sequenceid=6, filesize=6.8 K 2023-08-11 05:58:26,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for 8eda453f4c83aa112679dc1a9f17c3d8 in 52ms, sequenceid=6, compaction requested=false 2023-08-11 05:58:26,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/default/TestLogRolling-testLogRollOnDatanodeDeath/8eda453f4c83aa112679dc1a9f17c3d8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-11 05:58:26,521 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/info/b8ef806a986840d6abf7ddd5084e1245, entries=20, sequenceid=14, filesize=7.4 K 2023-08-11 05:58:26,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:26,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8eda453f4c83aa112679dc1a9f17c3d8: 2023-08-11 05:58:26,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1691733495969.8eda453f4c83aa112679dc1a9f17c3d8. 2023-08-11 05:58:26,523 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/.tmp/table/f05e29e5af7f4a08853f5881e1811929 as hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/table/f05e29e5af7f4a08853f5881e1811929 2023-08-11 05:58:26,531 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/table/f05e29e5af7f4a08853f5881e1811929, entries=4, sequenceid=14, filesize=4.8 K 2023-08-11 05:58:26,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.92 KB/2994, heapSize ~5.16 KB/5288, currentSize=0 B/0 for 1588230740 in 244ms, sequenceid=14, compaction requested=false 2023-08-11 05:58:26,541 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-08-11 05:58:26,542 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 05:58:26,543 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 05:58:26,543 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 05:58:26,543 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-11 05:58:26,690 INFO [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43767,1691733492608; all regions closed. 2023-08-11 05:58:26,958 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-11 05:58:26,958 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-11 05:58:27,942 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-11 05:58:30,284 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.1691733494094 after 4010ms 2023-08-11 05:58:30,285 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.1691733494094 to hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/oldWALs/jenkins-hbase4.apache.org%2C43767%2C1691733492608.1691733494094 2023-08-11 05:58:30,435 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta.1691733494188.meta after 4002ms 2023-08-11 05:58:30,436 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/WALs/jenkins-hbase4.apache.org,43767,1691733492608/jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta.1691733494188.meta to hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/oldWALs/jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta.1691733494188.meta 2023-08-11 05:58:30,442 DEBUG [RS:0;jenkins-hbase4:43767] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/oldWALs 2023-08-11 05:58:30,442 INFO [RS:0;jenkins-hbase4:43767] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43767%2C1691733492608.meta:.meta(num 1691733506299) 2023-08-11 05:58:30,450 DEBUG [RS:0;jenkins-hbase4:43767] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/oldWALs 2023-08-11 05:58:30,450 INFO [RS:0;jenkins-hbase4:43767] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43767%2C1691733492608:(num 1691733506249) 2023-08-11 05:58:30,450 DEBUG [RS:0;jenkins-hbase4:43767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:58:30,450 INFO [RS:0;jenkins-hbase4:43767] regionserver.LeaseManager(133): Closed leases 2023-08-11 05:58:30,451 INFO [RS:0;jenkins-hbase4:43767] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-11 05:58:30,451 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 05:58:30,452 INFO [RS:0;jenkins-hbase4:43767] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43767 2023-08-11 05:58:30,458 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43767,1691733492608 2023-08-11 05:58:30,458 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 05:58:30,458 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 05:58:30,460 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43767,1691733492608] 2023-08-11 05:58:30,460 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43767,1691733492608; numProcessing=1 2023-08-11 05:58:30,462 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43767,1691733492608 already deleted, retry=false 2023-08-11 05:58:30,462 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43767,1691733492608 expired; onlineServers=0 2023-08-11 05:58:30,462 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40419,1691733491429' ***** 2023-08-11 05:58:30,462 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-11 05:58:30,462 DEBUG [M:0;jenkins-hbase4:40419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@755a3e06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 05:58:30,462 INFO [M:0;jenkins-hbase4:40419] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40419,1691733491429 2023-08-11 05:58:30,462 INFO [M:0;jenkins-hbase4:40419] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40419,1691733491429; all regions closed. 2023-08-11 05:58:30,462 DEBUG [M:0;jenkins-hbase4:40419] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:58:30,463 DEBUG [M:0;jenkins-hbase4:40419] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-11 05:58:30,464 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-11 05:58:30,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691733493705] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691733493705,5,FailOnTimeoutGroup] 2023-08-11 05:58:30,464 DEBUG [M:0;jenkins-hbase4:40419] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-11 05:58:30,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691733493706] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691733493706,5,FailOnTimeoutGroup] 2023-08-11 05:58:30,465 INFO [M:0;jenkins-hbase4:40419] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-11 05:58:30,465 INFO [M:0;jenkins-hbase4:40419] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-11 05:58:30,465 INFO [M:0;jenkins-hbase4:40419] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-11 05:58:30,466 DEBUG [M:0;jenkins-hbase4:40419] master.HMaster(1512): Stopping service threads 2023-08-11 05:58:30,466 INFO [M:0;jenkins-hbase4:40419] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-11 05:58:30,466 ERROR [M:0;jenkins-hbase4:40419] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] 2023-08-11 05:58:30,467 INFO [M:0;jenkins-hbase4:40419] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-11 05:58:30,467 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-11 05:58:30,471 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-11 05:58:30,471 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:30,471 DEBUG [M:0;jenkins-hbase4:40419] zookeeper.ZKUtil(398): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-11 05:58:30,471 WARN [M:0;jenkins-hbase4:40419] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-11 05:58:30,471 INFO [M:0;jenkins-hbase4:40419] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-11 05:58:30,472 INFO [M:0;jenkins-hbase4:40419] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-11 05:58:30,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 05:58:30,472 DEBUG [M:0;jenkins-hbase4:40419] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 05:58:30,472 INFO [M:0;jenkins-hbase4:40419] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:58:30,472 DEBUG [M:0;jenkins-hbase4:40419] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:58:30,472 DEBUG [M:0;jenkins-hbase4:40419] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 05:58:30,472 DEBUG [M:0;jenkins-hbase4:40419] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:58:30,472 INFO [M:0;jenkins-hbase4:40419] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.07 KB heapSize=45.73 KB 2023-08-11 05:58:30,473 WARN [AsyncFSWAL-0-hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData-prefix:jenkins-hbase4.apache.org,40419,1691733491429] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:30,473 DEBUG [master:store-WAL-Roller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase4.apache.org%2C40419%2C1691733491429:(num 1691733493033) roll requested 2023-08-11 05:58:30,491 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40493,DS-e570ef3c-b298-4a8a-a766-c4286204eee8,DISK] 2023-08-11 05:58:30,491 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38593,DS-b54ae1f7-8526-4bc8-be8e-ae4c2f4171c3,DISK] 2023-08-11 05:58:30,495 INFO [master:store-WAL-Roller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/WALs/jenkins-hbase4.apache.org,40419,1691733491429/jenkins-hbase4.apache.org%2C40419%2C1691733491429.1691733493033 with entries=89, filesize=43.92 KB; new WAL /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/WALs/jenkins-hbase4.apache.org,40419,1691733491429/jenkins-hbase4.apache.org%2C40419%2C1691733491429.1691733510473 2023-08-11 05:58:30,495 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40493,DS-e570ef3c-b298-4a8a-a766-c4286204eee8,DISK], DatanodeInfoWithStorage[127.0.0.1:38593,DS-b54ae1f7-8526-4bc8-be8e-ae4c2f4171c3,DISK]] 2023-08-11 05:58:30,495 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(716): hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/WALs/jenkins-hbase4.apache.org,40419,1691733491429/jenkins-hbase4.apache.org%2C40419%2C1691733491429.1691733493033 is not closed yet, will try archiving it next time 2023-08-11 05:58:30,495 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:30,495 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-08-11 05:58:30,496 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/WALs/jenkins-hbase4.apache.org,40419,1691733491429/jenkins-hbase4.apache.org%2C40419%2C1691733491429.1691733493033 2023-08-11 05:58:30,497 WARN [IPC Server handler 2 on default port 36289] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/WALs/jenkins-hbase4.apache.org,40419,1691733491429/jenkins-hbase4.apache.org%2C40419%2C1691733491429.1691733493033 has not been closed. Lease recovery is in progress. RecoveryId = 1024 for block blk_1073741829_1005 2023-08-11 05:58:30,497 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/WALs/jenkins-hbase4.apache.org,40419,1691733491429/jenkins-hbase4.apache.org%2C40419%2C1691733491429.1691733493033 after 1ms 2023-08-11 05:58:30,513 INFO [M:0;jenkins-hbase4:40419] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.07 KB at sequenceid=91 (bloomFilter=true), to=hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d3359582fc0a43edbd78fced8c759a66 2023-08-11 05:58:30,522 DEBUG [M:0;jenkins-hbase4:40419] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d3359582fc0a43edbd78fced8c759a66 as hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d3359582fc0a43edbd78fced8c759a66 2023-08-11 05:58:30,529 INFO [M:0;jenkins-hbase4:40419] regionserver.HStore(1080): Added hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d3359582fc0a43edbd78fced8c759a66, entries=11, sequenceid=91, filesize=7.0 K 2023-08-11 05:58:30,530 INFO [M:0;jenkins-hbase4:40419] regionserver.HRegion(2948): Finished flush of dataSize ~38.07 KB/38985, heapSize ~45.72 KB/46816, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 58ms, sequenceid=91, compaction requested=false 2023-08-11 05:58:30,531 INFO [M:0;jenkins-hbase4:40419] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:58:30,531 DEBUG [M:0;jenkins-hbase4:40419] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 05:58:30,560 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:58:30,560 INFO [RS:0;jenkins-hbase4:43767] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43767,1691733492608; zookeeper connection closed. 2023-08-11 05:58:30,560 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x101f29afe790001, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:58:30,561 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7a80851b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7a80851b 2023-08-11 05:58:30,561 INFO [Listener at localhost/40135] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-11 05:58:31,997 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-11 05:58:32,043 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 05:58:34,498 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/WALs/jenkins-hbase4.apache.org,40419,1691733491429/jenkins-hbase4.apache.org%2C40419%2C1691733491429.1691733493033 after 4002ms 2023-08-11 05:58:34,499 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/WALs/jenkins-hbase4.apache.org,40419,1691733491429/jenkins-hbase4.apache.org%2C40419%2C1691733491429.1691733493033 to hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/oldWALs/jenkins-hbase4.apache.org%2C40419%2C1691733491429.1691733493033 2023-08-11 05:58:34,504 INFO [WAL-Archive-0] region.MasterRegionUtils(50): Moved hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/MasterData/oldWALs/jenkins-hbase4.apache.org%2C40419%2C1691733491429.1691733493033 to hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/oldWALs/jenkins-hbase4.apache.org%2C40419%2C1691733491429.1691733493033$masterlocalwal$ 2023-08-11 05:58:34,505 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 05:58:34,505 INFO [M:0;jenkins-hbase4:40419] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-11 05:58:34,505 INFO [M:0;jenkins-hbase4:40419] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40419 2023-08-11 05:58:34,507 DEBUG [M:0;jenkins-hbase4:40419] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40419,1691733491429 already deleted, retry=false 2023-08-11 05:58:34,609 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:58:34,609 INFO [M:0;jenkins-hbase4:40419] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40419,1691733491429; zookeeper connection closed. 2023-08-11 05:58:34,609 DEBUG [Listener at localhost/33971-EventThread] zookeeper.ZKWatcher(600): master:40419-0x101f29afe790000, quorum=127.0.0.1:62520, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:58:34,611 WARN [Listener at localhost/40135] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 05:58:34,615 INFO [Listener at localhost/40135] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:58:34,719 WARN [BP-1158019010-172.31.14.131-1691733488418 heartbeating to localhost/127.0.0.1:36289] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 05:58:34,719 WARN [BP-1158019010-172.31.14.131-1691733488418 heartbeating to localhost/127.0.0.1:36289] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1158019010-172.31.14.131-1691733488418 (Datanode Uuid 8e6892bb-bfc6-4873-8e37-4b5c8104cb51) service to localhost/127.0.0.1:36289 2023-08-11 05:58:34,720 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/dfs/data/data3/current/BP-1158019010-172.31.14.131-1691733488418] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:58:34,720 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/dfs/data/data4/current/BP-1158019010-172.31.14.131-1691733488418] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:58:34,722 WARN [Listener at localhost/40135] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 05:58:34,726 INFO [Listener at localhost/40135] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:58:34,830 WARN [BP-1158019010-172.31.14.131-1691733488418 heartbeating to localhost/127.0.0.1:36289] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 05:58:34,830 WARN [BP-1158019010-172.31.14.131-1691733488418 heartbeating to localhost/127.0.0.1:36289] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1158019010-172.31.14.131-1691733488418 (Datanode Uuid 1efe9024-ae3c-496d-9c01-1c413a6829ee) service to localhost/127.0.0.1:36289 2023-08-11 05:58:34,830 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/dfs/data/data9/current/BP-1158019010-172.31.14.131-1691733488418] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:58:34,831 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/dfs/data/data10/current/BP-1158019010-172.31.14.131-1691733488418] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:58:34,832 WARN [Listener at localhost/40135] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 05:58:34,835 INFO [Listener at localhost/40135] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:58:34,938 WARN [BP-1158019010-172.31.14.131-1691733488418 heartbeating to localhost/127.0.0.1:36289] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 05:58:34,938 WARN [BP-1158019010-172.31.14.131-1691733488418 heartbeating to localhost/127.0.0.1:36289] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1158019010-172.31.14.131-1691733488418 (Datanode Uuid 95a65231-7ff1-4088-bab7-ce571c2fc3d9) service to localhost/127.0.0.1:36289 2023-08-11 05:58:34,939 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/dfs/data/data7/current/BP-1158019010-172.31.14.131-1691733488418] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:58:34,939 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/dfs/data/data8/current/BP-1158019010-172.31.14.131-1691733488418] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:58:34,940 WARN [Listener at localhost/40135] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 05:58:34,944 INFO [Listener at localhost/40135] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:58:35,048 WARN [BP-1158019010-172.31.14.131-1691733488418 heartbeating to localhost/127.0.0.1:36289] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 05:58:35,048 WARN [BP-1158019010-172.31.14.131-1691733488418 heartbeating to localhost/127.0.0.1:36289] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1158019010-172.31.14.131-1691733488418 (Datanode Uuid a0e02ea1-c550-43aa-ab04-34f9f5c55748) service to localhost/127.0.0.1:36289 2023-08-11 05:58:35,048 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/dfs/data/data5/current/BP-1158019010-172.31.14.131-1691733488418] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:58:35,049 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/dfs/data/data6/current/BP-1158019010-172.31.14.131-1691733488418] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:58:35,050 WARN [Listener at localhost/40135] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 05:58:35,052 INFO [Listener at localhost/40135] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:58:35,153 WARN [BP-1158019010-172.31.14.131-1691733488418 heartbeating to localhost/127.0.0.1:36289] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 05:58:35,153 WARN [BP-1158019010-172.31.14.131-1691733488418 heartbeating to localhost/127.0.0.1:36289] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1158019010-172.31.14.131-1691733488418 (Datanode Uuid 686fcc46-bbd8-4850-b17d-dc366d189a2f) service to localhost/127.0.0.1:36289 2023-08-11 05:58:35,154 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/dfs/data/data1/current/BP-1158019010-172.31.14.131-1691733488418] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:58:35,154 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/cluster_f97ed2d6-c050-92ad-ff0e-8ce5677d42c7/dfs/data/data2/current/BP-1158019010-172.31.14.131-1691733488418] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:58:35,189 INFO [Listener at localhost/40135] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:58:35,304 INFO [Listener at localhost/40135] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-11 05:58:35,346 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-11 05:58:35,358 INFO [Listener at localhost/40135] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=78 (was 10) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (503161465) connection to localhost/127.0.0.1:36289 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (503161465) connection to localhost/127.0.0.1:36289 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (503161465) connection to localhost/127.0.0.1:36289 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@7e49b44a java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36289 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40135 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:36289 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=467 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=168 (was 183), ProcessCount=171 (was 171), AvailableMemoryMB=3112 (was 3761) 2023-08-11 05:58:35,368 INFO [Listener at localhost/40135] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=78, OpenFileDescriptor=467, MaxFileDescriptor=60000, SystemLoadAverage=168, ProcessCount=171, AvailableMemoryMB=3112 2023-08-11 05:58:35,368 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-11 05:58:35,369 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/hadoop.log.dir so I do NOT create it in target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4 2023-08-11 05:58:35,369 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/43ea518f-82c6-c238-7d63-bd014a5544ca/hadoop.tmp.dir so I do NOT create it in target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4 2023-08-11 05:58:35,369 INFO [Listener at localhost/40135] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/cluster_1e106661-9bb2-c9ba-eca8-9c6819f6b0a8, deleteOnExit=true 2023-08-11 05:58:35,369 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-11 05:58:35,369 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/test.cache.data in system properties and HBase conf 2023-08-11 05:58:35,369 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/hadoop.tmp.dir in system properties and HBase conf 2023-08-11 05:58:35,369 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/hadoop.log.dir in system properties and HBase conf 2023-08-11 05:58:35,369 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-11 05:58:35,370 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-11 05:58:35,370 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-11 05:58:35,370 DEBUG [Listener at localhost/40135] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-11 05:58:35,370 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-11 05:58:35,371 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-11 05:58:35,371 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-11 05:58:35,371 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 05:58:35,371 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-11 05:58:35,372 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-11 05:58:35,372 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 05:58:35,372 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 05:58:35,372 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-11 05:58:35,372 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/nfs.dump.dir in system properties and HBase conf 2023-08-11 05:58:35,373 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/java.io.tmpdir in system properties and HBase conf 2023-08-11 05:58:35,373 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 05:58:35,373 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-11 05:58:35,373 INFO [Listener at localhost/40135] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-11 05:58:35,381 WARN [Listener at localhost/40135] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 05:58:35,381 WARN [Listener at localhost/40135] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 05:58:35,426 WARN [Listener at localhost/40135] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:58:35,428 INFO [Listener at localhost/40135] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:58:35,433 INFO [Listener at localhost/40135] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/java.io.tmpdir/Jetty_localhost_36345_hdfs____noypgb/webapp 2023-08-11 05:58:35,526 INFO [Listener at localhost/40135] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36345 2023-08-11 05:58:35,534 WARN [Listener at localhost/40135] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 05:58:35,535 WARN [Listener at localhost/40135] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 05:58:35,572 WARN [Listener at localhost/44391] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:58:35,584 WARN [Listener at localhost/44391] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 05:58:35,586 WARN [Listener at localhost/44391] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:58:35,587 INFO [Listener at localhost/44391] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:58:35,592 INFO [Listener at localhost/44391] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/java.io.tmpdir/Jetty_localhost_34805_datanode____.9vq1gd/webapp 2023-08-11 05:58:35,685 INFO [Listener at localhost/44391] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34805 2023-08-11 05:58:35,692 WARN [Listener at localhost/46023] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:58:35,709 WARN [Listener at localhost/46023] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 05:58:35,712 WARN [Listener at localhost/46023] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:58:35,713 INFO [Listener at localhost/46023] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:58:35,719 INFO [Listener at localhost/46023] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/java.io.tmpdir/Jetty_localhost_36347_datanode____iijyfu/webapp 2023-08-11 05:58:35,794 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x768b01248aa58918: Processing first storage report for DS-c67752e3-1efe-4237-b61a-290e8897ff79 from datanode aa4a436a-1811-43bc-bede-caa56d1dc200 2023-08-11 05:58:35,794 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x768b01248aa58918: from storage DS-c67752e3-1efe-4237-b61a-290e8897ff79 node DatanodeRegistration(127.0.0.1:36827, datanodeUuid=aa4a436a-1811-43bc-bede-caa56d1dc200, infoPort=35857, infoSecurePort=0, ipcPort=46023, storageInfo=lv=-57;cid=testClusterID;nsid=785041339;c=1691733515385), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:58:35,794 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x768b01248aa58918: Processing first storage report for DS-16754b54-411a-4769-8763-71b043af6ca4 from datanode aa4a436a-1811-43bc-bede-caa56d1dc200 2023-08-11 05:58:35,794 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x768b01248aa58918: from storage DS-16754b54-411a-4769-8763-71b043af6ca4 node DatanodeRegistration(127.0.0.1:36827, datanodeUuid=aa4a436a-1811-43bc-bede-caa56d1dc200, infoPort=35857, infoSecurePort=0, ipcPort=46023, storageInfo=lv=-57;cid=testClusterID;nsid=785041339;c=1691733515385), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:58:35,821 INFO [Listener at localhost/46023] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36347 2023-08-11 05:58:35,829 WARN [Listener at localhost/36517] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:58:35,933 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x57bf06d649ef0ba4: Processing first storage report for DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0 from datanode d4196803-1d1e-45f6-b06d-798356d7fe94 2023-08-11 05:58:35,933 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x57bf06d649ef0ba4: from storage DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0 node DatanodeRegistration(127.0.0.1:34603, datanodeUuid=d4196803-1d1e-45f6-b06d-798356d7fe94, infoPort=42999, infoSecurePort=0, ipcPort=36517, storageInfo=lv=-57;cid=testClusterID;nsid=785041339;c=1691733515385), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:58:35,933 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x57bf06d649ef0ba4: Processing first storage report for DS-f986c848-9a58-4f77-a577-a50352ca03cb from datanode d4196803-1d1e-45f6-b06d-798356d7fe94 2023-08-11 05:58:35,933 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x57bf06d649ef0ba4: from storage DS-f986c848-9a58-4f77-a577-a50352ca03cb node DatanodeRegistration(127.0.0.1:34603, datanodeUuid=d4196803-1d1e-45f6-b06d-798356d7fe94, infoPort=42999, infoSecurePort=0, ipcPort=36517, storageInfo=lv=-57;cid=testClusterID;nsid=785041339;c=1691733515385), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-11 05:58:35,936 DEBUG [Listener at localhost/36517] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4 2023-08-11 05:58:35,942 INFO [Listener at localhost/36517] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/cluster_1e106661-9bb2-c9ba-eca8-9c6819f6b0a8/zookeeper_0, clientPort=63751, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/cluster_1e106661-9bb2-c9ba-eca8-9c6819f6b0a8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/cluster_1e106661-9bb2-c9ba-eca8-9c6819f6b0a8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-11 05:58:35,943 INFO [Listener at localhost/36517] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63751 2023-08-11 05:58:35,944 INFO [Listener at localhost/36517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:35,945 INFO [Listener at localhost/36517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:35,960 INFO [Listener at localhost/36517] util.FSUtils(471): Created version file at hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675 with version=8 2023-08-11 05:58:35,960 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/hbase-staging 2023-08-11 05:58:35,962 INFO [Listener at localhost/36517] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 05:58:35,963 INFO [Listener at localhost/36517] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:58:35,963 INFO [Listener at localhost/36517] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 05:58:35,963 INFO [Listener at localhost/36517] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 05:58:35,963 INFO [Listener at localhost/36517] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:58:35,963 INFO [Listener at localhost/36517] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 05:58:35,963 INFO [Listener at localhost/36517] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 05:58:35,964 INFO [Listener at localhost/36517] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36579 2023-08-11 05:58:35,965 INFO [Listener at localhost/36517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:35,966 INFO [Listener at localhost/36517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:35,967 INFO [Listener at localhost/36517] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36579 connecting to ZooKeeper ensemble=127.0.0.1:63751 2023-08-11 05:58:35,974 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:365790x0, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 05:58:35,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36579-0x101f29b61a80000 connected 2023-08-11 05:58:35,991 DEBUG [Listener at localhost/36517] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 05:58:35,991 DEBUG [Listener at localhost/36517] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:58:35,992 DEBUG [Listener at localhost/36517] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 05:58:35,992 DEBUG [Listener at localhost/36517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36579 2023-08-11 05:58:35,992 DEBUG [Listener at localhost/36517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36579 2023-08-11 05:58:35,993 DEBUG [Listener at localhost/36517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36579 2023-08-11 05:58:35,993 DEBUG [Listener at localhost/36517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36579 2023-08-11 05:58:35,993 DEBUG [Listener at localhost/36517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36579 2023-08-11 05:58:35,993 INFO [Listener at localhost/36517] master.HMaster(444): hbase.rootdir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675, hbase.cluster.distributed=false 2023-08-11 05:58:36,007 INFO [Listener at localhost/36517] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 05:58:36,007 INFO [Listener at localhost/36517] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:58:36,007 INFO [Listener at localhost/36517] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 05:58:36,007 INFO [Listener at localhost/36517] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 05:58:36,007 INFO [Listener at localhost/36517] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:58:36,008 INFO [Listener at localhost/36517] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 05:58:36,008 INFO [Listener at localhost/36517] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 05:58:36,009 INFO [Listener at localhost/36517] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34839 2023-08-11 05:58:36,009 INFO [Listener at localhost/36517] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-11 05:58:36,010 DEBUG [Listener at localhost/36517] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-11 05:58:36,011 INFO [Listener at localhost/36517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:36,012 INFO [Listener at localhost/36517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:36,014 INFO [Listener at localhost/36517] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34839 connecting to ZooKeeper ensemble=127.0.0.1:63751 2023-08-11 05:58:36,017 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:348390x0, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 05:58:36,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34839-0x101f29b61a80001 connected 2023-08-11 05:58:36,018 DEBUG [Listener at localhost/36517] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 05:58:36,019 DEBUG [Listener at localhost/36517] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:58:36,019 DEBUG [Listener at localhost/36517] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 05:58:36,020 DEBUG [Listener at localhost/36517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34839 2023-08-11 05:58:36,020 DEBUG [Listener at localhost/36517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34839 2023-08-11 05:58:36,022 DEBUG [Listener at localhost/36517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34839 2023-08-11 05:58:36,025 DEBUG [Listener at localhost/36517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34839 2023-08-11 05:58:36,025 DEBUG [Listener at localhost/36517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34839 2023-08-11 05:58:36,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36579,1691733515962 2023-08-11 05:58:36,028 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 05:58:36,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36579,1691733515962 2023-08-11 05:58:36,030 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 05:58:36,030 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 05:58:36,030 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:36,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 05:58:36,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 05:58:36,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36579,1691733515962 from backup master directory 2023-08-11 05:58:36,034 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36579,1691733515962 2023-08-11 05:58:36,034 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 05:58:36,034 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 05:58:36,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36579,1691733515962 2023-08-11 05:58:36,050 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/hbase.id with ID: 2a7e6171-4868-4eaf-909d-bc6d46a0d5e7 2023-08-11 05:58:36,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:36,068 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:36,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x13c69b5b to 127.0.0.1:63751 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 05:58:36,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a960003, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 05:58:36,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 05:58:36,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-11 05:58:36,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:58:36,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/data/master/store-tmp 2023-08-11 05:58:36,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:36,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 05:58:36,095 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:58:36,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:58:36,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 05:58:36,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:58:36,095 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:58:36,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 05:58:36,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/WALs/jenkins-hbase4.apache.org,36579,1691733515962 2023-08-11 05:58:36,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36579%2C1691733515962, suffix=, logDir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/WALs/jenkins-hbase4.apache.org,36579,1691733515962, archiveDir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/oldWALs, maxLogs=10 2023-08-11 05:58:36,115 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34603,DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0,DISK] 2023-08-11 05:58:36,116 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36827,DS-c67752e3-1efe-4237-b61a-290e8897ff79,DISK] 2023-08-11 05:58:36,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/WALs/jenkins-hbase4.apache.org,36579,1691733515962/jenkins-hbase4.apache.org%2C36579%2C1691733515962.1691733516099 2023-08-11 05:58:36,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34603,DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0,DISK], DatanodeInfoWithStorage[127.0.0.1:36827,DS-c67752e3-1efe-4237-b61a-290e8897ff79,DISK]] 2023-08-11 05:58:36,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:58:36,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:36,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:58:36,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:58:36,121 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:58:36,123 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-11 05:58:36,123 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-11 05:58:36,124 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:36,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:58:36,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:58:36,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:58:36,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:58:36,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=728358, jitterRate=-0.07384514808654785}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:58:36,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 05:58:36,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-11 05:58:36,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-11 05:58:36,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-11 05:58:36,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-11 05:58:36,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-11 05:58:36,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-11 05:58:36,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-11 05:58:36,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-11 05:58:36,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-11 05:58:36,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-11 05:58:36,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-11 05:58:36,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-11 05:58:36,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-11 05:58:36,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-11 05:58:36,153 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:36,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-11 05:58:36,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-11 05:58:36,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-11 05:58:36,159 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 05:58:36,159 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 05:58:36,159 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:36,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36579,1691733515962, sessionid=0x101f29b61a80000, setting cluster-up flag (Was=false) 2023-08-11 05:58:36,163 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:36,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-11 05:58:36,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36579,1691733515962 2023-08-11 05:58:36,176 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:36,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-11 05:58:36,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36579,1691733515962 2023-08-11 05:58:36,183 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/.hbase-snapshot/.tmp 2023-08-11 05:58:36,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-11 05:58:36,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:58:36,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:58:36,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:58:36,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:58:36,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-11 05:58:36,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:36,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 05:58:36,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:36,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1691733546194 2023-08-11 05:58:36,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-11 05:58:36,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-11 05:58:36,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-11 05:58:36,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-11 05:58:36,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-11 05:58:36,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-11 05:58:36,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-11 05:58:36,196 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 05:58:36,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-11 05:58:36,196 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-11 05:58:36,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-11 05:58:36,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-11 05:58:36,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-11 05:58:36,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691733516196,5,FailOnTimeoutGroup] 2023-08-11 05:58:36,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691733516196,5,FailOnTimeoutGroup] 2023-08-11 05:58:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-11 05:58:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,197 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 05:58:36,211 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 05:58:36,212 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 05:58:36,212 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675 2023-08-11 05:58:36,222 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:36,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 05:58:36,226 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/info 2023-08-11 05:58:36,227 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(951): ClusterId : 2a7e6171-4868-4eaf-909d-bc6d46a0d5e7 2023-08-11 05:58:36,227 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-11 05:58:36,227 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 05:58:36,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:36,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 05:58:36,230 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-11 05:58:36,230 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-11 05:58:36,231 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/rep_barrier 2023-08-11 05:58:36,231 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 05:58:36,232 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:36,232 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 05:58:36,233 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/table 2023-08-11 05:58:36,234 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 05:58:36,234 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-11 05:58:36,235 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ReadOnlyZKClient(139): Connect 0x1e9caec5 to 127.0.0.1:63751 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 05:58:36,235 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:36,237 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740 2023-08-11 05:58:36,237 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740 2023-08-11 05:58:36,240 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 05:58:36,241 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 05:58:36,244 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:58:36,245 DEBUG [RS:0;jenkins-hbase4:34839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@105b4366, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 05:58:36,245 DEBUG [RS:0;jenkins-hbase4:34839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1464c5b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 05:58:36,245 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=800712, jitterRate=0.018158525228500366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 05:58:36,246 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 05:58:36,246 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 05:58:36,246 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 05:58:36,246 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 05:58:36,246 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 05:58:36,246 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 05:58:36,247 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 05:58:36,247 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 05:58:36,248 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 05:58:36,248 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-11 05:58:36,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-11 05:58:36,250 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-11 05:58:36,251 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-11 05:58:36,256 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34839 2023-08-11 05:58:36,256 INFO [RS:0;jenkins-hbase4:34839] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-11 05:58:36,256 INFO [RS:0;jenkins-hbase4:34839] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-11 05:58:36,256 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1022): About to register with Master. 2023-08-11 05:58:36,257 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36579,1691733515962 with isa=jenkins-hbase4.apache.org/172.31.14.131:34839, startcode=1691733516007 2023-08-11 05:58:36,257 DEBUG [RS:0;jenkins-hbase4:34839] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-11 05:58:36,259 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36743, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-08-11 05:58:36,260 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36579] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:36,261 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675 2023-08-11 05:58:36,261 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44391 2023-08-11 05:58:36,261 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-11 05:58:36,263 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 05:58:36,264 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ZKUtil(162): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:36,264 WARN [RS:0;jenkins-hbase4:34839] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 05:58:36,264 INFO [RS:0;jenkins-hbase4:34839] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:58:36,264 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:36,264 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34839,1691733516007] 2023-08-11 05:58:36,268 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ZKUtil(162): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:36,269 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-11 05:58:36,269 INFO [RS:0;jenkins-hbase4:34839] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-11 05:58:36,271 INFO [RS:0;jenkins-hbase4:34839] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-11 05:58:36,272 INFO [RS:0;jenkins-hbase4:34839] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-11 05:58:36,272 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,272 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-11 05:58:36,273 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,274 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:36,274 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:36,274 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:36,274 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:36,274 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:36,274 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 05:58:36,274 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:36,274 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:36,274 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:36,274 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:58:36,277 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,277 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,277 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,289 INFO [RS:0;jenkins-hbase4:34839] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-11 05:58:36,289 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34839,1691733516007-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,302 INFO [RS:0;jenkins-hbase4:34839] regionserver.Replication(203): jenkins-hbase4.apache.org,34839,1691733516007 started 2023-08-11 05:58:36,302 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34839,1691733516007, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34839, sessionid=0x101f29b61a80001 2023-08-11 05:58:36,302 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-11 05:58:36,302 DEBUG [RS:0;jenkins-hbase4:34839] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:36,302 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34839,1691733516007' 2023-08-11 05:58:36,302 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:58:36,302 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:58:36,303 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-11 05:58:36,303 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-11 05:58:36,303 DEBUG [RS:0;jenkins-hbase4:34839] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:36,303 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34839,1691733516007' 2023-08-11 05:58:36,303 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-11 05:58:36,303 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-11 05:58:36,304 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-11 05:58:36,304 INFO [RS:0;jenkins-hbase4:34839] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-11 05:58:36,304 INFO [RS:0;jenkins-hbase4:34839] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-11 05:58:36,402 DEBUG [jenkins-hbase4:36579] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-11 05:58:36,403 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34839,1691733516007, state=OPENING 2023-08-11 05:58:36,404 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-11 05:58:36,406 INFO [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34839%2C1691733516007, suffix=, logDir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007, archiveDir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/oldWALs, maxLogs=32 2023-08-11 05:58:36,407 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:36,407 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34839,1691733516007}] 2023-08-11 05:58:36,407 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 05:58:36,425 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36827,DS-c67752e3-1efe-4237-b61a-290e8897ff79,DISK] 2023-08-11 05:58:36,425 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34603,DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0,DISK] 2023-08-11 05:58:36,428 INFO [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733516408 2023-08-11 05:58:36,428 DEBUG [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36827,DS-c67752e3-1efe-4237-b61a-290e8897ff79,DISK], DatanodeInfoWithStorage[127.0.0.1:34603,DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0,DISK]] 2023-08-11 05:58:36,562 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:36,562 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-11 05:58:36,564 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-11 05:58:36,569 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-11 05:58:36,569 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:58:36,571 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34839%2C1691733516007.meta, suffix=.meta, logDir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007, archiveDir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/oldWALs, maxLogs=32 2023-08-11 05:58:36,587 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34603,DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0,DISK] 2023-08-11 05:58:36,587 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36827,DS-c67752e3-1efe-4237-b61a-290e8897ff79,DISK] 2023-08-11 05:58:36,590 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.meta.1691733516572.meta 2023-08-11 05:58:36,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34603,DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0,DISK], DatanodeInfoWithStorage[127.0.0.1:36827,DS-c67752e3-1efe-4237-b61a-290e8897ff79,DISK]] 2023-08-11 05:58:36,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:58:36,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-11 05:58:36,591 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-11 05:58:36,591 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-11 05:58:36,591 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-11 05:58:36,591 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:36,592 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-11 05:58:36,592 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-11 05:58:36,595 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 05:58:36,596 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/info 2023-08-11 05:58:36,596 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/info 2023-08-11 05:58:36,596 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 05:58:36,597 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:36,597 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 05:58:36,598 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/rep_barrier 2023-08-11 05:58:36,598 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/rep_barrier 2023-08-11 05:58:36,598 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 05:58:36,599 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:36,599 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 05:58:36,600 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/table 2023-08-11 05:58:36,600 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/table 2023-08-11 05:58:36,601 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 05:58:36,602 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:36,603 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740 2023-08-11 05:58:36,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740 2023-08-11 05:58:36,607 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 05:58:36,608 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 05:58:36,609 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=805426, jitterRate=0.024152621626853943}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 05:58:36,609 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 05:58:36,610 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1691733516562 2023-08-11 05:58:36,614 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-11 05:58:36,615 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-11 05:58:36,616 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34839,1691733516007, state=OPEN 2023-08-11 05:58:36,618 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-11 05:58:36,618 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 05:58:36,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-11 05:58:36,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34839,1691733516007 in 211 msec 2023-08-11 05:58:36,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-11 05:58:36,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 373 msec 2023-08-11 05:58:36,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 440 msec 2023-08-11 05:58:36,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1691733516626, completionTime=-1 2023-08-11 05:58:36,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-11 05:58:36,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-11 05:58:36,629 DEBUG [hconnection-0x19b1f38e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 05:58:36,631 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 05:58:36,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-11 05:58:36,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1691733576633 2023-08-11 05:58:36,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1691733636633 2023-08-11 05:58:36,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 6 msec 2023-08-11 05:58:36,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36579,1691733515962-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36579,1691733515962-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36579,1691733515962-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36579, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-11 05:58:36,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-11 05:58:36,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 05:58:36,641 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-11 05:58:36,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-11 05:58:36,642 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 05:58:36,643 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 05:58:36,645 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/.tmp/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db 2023-08-11 05:58:36,646 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/.tmp/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db empty. 2023-08-11 05:58:36,647 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/.tmp/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db 2023-08-11 05:58:36,647 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-11 05:58:36,662 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-11 05:58:36,663 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 19f92cd607e4294f9d50c2a485b9d1db, NAME => 'hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/.tmp 2023-08-11 05:58:36,674 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:36,674 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 19f92cd607e4294f9d50c2a485b9d1db, disabling compactions & flushes 2023-08-11 05:58:36,674 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:58:36,674 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:58:36,674 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. after waiting 0 ms 2023-08-11 05:58:36,674 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:58:36,674 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:58:36,674 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 19f92cd607e4294f9d50c2a485b9d1db: 2023-08-11 05:58:36,677 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 05:58:36,678 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691733516678"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691733516678"}]},"ts":"1691733516678"} 2023-08-11 05:58:36,680 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 05:58:36,681 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 05:58:36,682 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733516682"}]},"ts":"1691733516682"} 2023-08-11 05:58:36,683 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-11 05:58:36,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=19f92cd607e4294f9d50c2a485b9d1db, ASSIGN}] 2023-08-11 05:58:36,693 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=19f92cd607e4294f9d50c2a485b9d1db, ASSIGN 2023-08-11 05:58:36,694 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=19f92cd607e4294f9d50c2a485b9d1db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34839,1691733516007; forceNewPlan=false, retain=false 2023-08-11 05:58:36,845 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=19f92cd607e4294f9d50c2a485b9d1db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:36,845 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691733516845"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691733516845"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691733516845"}]},"ts":"1691733516845"} 2023-08-11 05:58:36,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 19f92cd607e4294f9d50c2a485b9d1db, server=jenkins-hbase4.apache.org,34839,1691733516007}] 2023-08-11 05:58:37,006 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:58:37,006 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19f92cd607e4294f9d50c2a485b9d1db, NAME => 'hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db.', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:58:37,006 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 19f92cd607e4294f9d50c2a485b9d1db 2023-08-11 05:58:37,006 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:37,007 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 19f92cd607e4294f9d50c2a485b9d1db 2023-08-11 05:58:37,007 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 19f92cd607e4294f9d50c2a485b9d1db 2023-08-11 05:58:37,008 INFO [StoreOpener-19f92cd607e4294f9d50c2a485b9d1db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 19f92cd607e4294f9d50c2a485b9d1db 2023-08-11 05:58:37,010 DEBUG [StoreOpener-19f92cd607e4294f9d50c2a485b9d1db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db/info 2023-08-11 05:58:37,010 DEBUG [StoreOpener-19f92cd607e4294f9d50c2a485b9d1db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db/info 2023-08-11 05:58:37,011 INFO [StoreOpener-19f92cd607e4294f9d50c2a485b9d1db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19f92cd607e4294f9d50c2a485b9d1db columnFamilyName info 2023-08-11 05:58:37,011 INFO [StoreOpener-19f92cd607e4294f9d50c2a485b9d1db-1] regionserver.HStore(310): Store=19f92cd607e4294f9d50c2a485b9d1db/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:37,012 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db 2023-08-11 05:58:37,013 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db 2023-08-11 05:58:37,017 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 19f92cd607e4294f9d50c2a485b9d1db 2023-08-11 05:58:37,019 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:58:37,020 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 19f92cd607e4294f9d50c2a485b9d1db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=707649, jitterRate=-0.10017856955528259}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:58:37,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 19f92cd607e4294f9d50c2a485b9d1db: 2023-08-11 05:58:37,021 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db., pid=6, masterSystemTime=1691733517001 2023-08-11 05:58:37,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:58:37,024 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:58:37,025 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=19f92cd607e4294f9d50c2a485b9d1db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:37,025 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691733517025"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691733517025"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691733517025"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691733517025"}]},"ts":"1691733517025"} 2023-08-11 05:58:37,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-11 05:58:37,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 19f92cd607e4294f9d50c2a485b9d1db, server=jenkins-hbase4.apache.org,34839,1691733516007 in 179 msec 2023-08-11 05:58:37,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-11 05:58:37,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=19f92cd607e4294f9d50c2a485b9d1db, ASSIGN in 339 msec 2023-08-11 05:58:37,034 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 05:58:37,034 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733517034"}]},"ts":"1691733517034"} 2023-08-11 05:58:37,036 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-11 05:58:37,039 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 05:58:37,041 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 399 msec 2023-08-11 05:58:37,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-11 05:58:37,043 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-11 05:58:37,043 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:37,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-11 05:58:37,057 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 05:58:37,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-08-11 05:58:37,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-11 05:58:37,078 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 05:58:37,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-08-11 05:58:37,097 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-11 05:58:37,100 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-11 05:58:37,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.066sec 2023-08-11 05:58:37,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-11 05:58:37,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-11 05:58:37,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-11 05:58:37,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36579,1691733515962-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-11 05:58:37,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36579,1691733515962-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-11 05:58:37,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-11 05:58:37,127 DEBUG [Listener at localhost/36517] zookeeper.ReadOnlyZKClient(139): Connect 0x411f5a54 to 127.0.0.1:63751 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 05:58:37,132 DEBUG [Listener at localhost/36517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d7edd75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 05:58:37,133 DEBUG [hconnection-0x9b3403c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 05:58:37,136 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 05:58:37,138 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36579,1691733515962 2023-08-11 05:58:37,138 INFO [Listener at localhost/36517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:58:37,142 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-11 05:58:37,142 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:58:37,143 INFO [Listener at localhost/36517] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-11 05:58:37,145 DEBUG [Listener at localhost/36517] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-11 05:58:37,194 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-11 05:58:37,196 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-11 05:58:37,196 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-11 05:58:37,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 05:58:37,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:37,201 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 05:58:37,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testCompactionRecordDoesntBlockRolling" procId is: 9 2023-08-11 05:58:37,202 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 05:58:37,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-11 05:58:37,204 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a 2023-08-11 05:58:37,205 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a empty. 2023-08-11 05:58:37,206 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a 2023-08-11 05:58:37,206 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testCompactionRecordDoesntBlockRolling regions 2023-08-11 05:58:37,221 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/.tabledesc/.tableinfo.0000000001 2023-08-11 05:58:37,223 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => 58f613c4158957056d1242e3f1496d2a, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/.tmp 2023-08-11 05:58:37,237 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:37,237 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1604): Closing 58f613c4158957056d1242e3f1496d2a, disabling compactions & flushes 2023-08-11 05:58:37,237 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:58:37,237 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:58:37,237 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. after waiting 0 ms 2023-08-11 05:58:37,237 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:58:37,237 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:58:37,237 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1558): Region close journal for 58f613c4158957056d1242e3f1496d2a: 2023-08-11 05:58:37,240 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 05:58:37,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1691733517242"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691733517242"}]},"ts":"1691733517242"} 2023-08-11 05:58:37,245 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 05:58:37,246 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 05:58:37,246 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733517246"}]},"ts":"1691733517246"} 2023-08-11 05:58:37,248 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLING in hbase:meta 2023-08-11 05:58:37,252 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=58f613c4158957056d1242e3f1496d2a, ASSIGN}] 2023-08-11 05:58:37,254 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=58f613c4158957056d1242e3f1496d2a, ASSIGN 2023-08-11 05:58:37,255 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=58f613c4158957056d1242e3f1496d2a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34839,1691733516007; forceNewPlan=false, retain=false 2023-08-11 05:58:37,406 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=58f613c4158957056d1242e3f1496d2a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:37,406 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1691733517406"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691733517406"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691733517406"}]},"ts":"1691733517406"} 2023-08-11 05:58:37,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 58f613c4158957056d1242e3f1496d2a, server=jenkins-hbase4.apache.org,34839,1691733516007}] 2023-08-11 05:58:37,545 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-11 05:58:37,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:58:37,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 58f613c4158957056d1242e3f1496d2a, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a.', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:58:37,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testCompactionRecordDoesntBlockRolling 58f613c4158957056d1242e3f1496d2a 2023-08-11 05:58:37,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:58:37,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 58f613c4158957056d1242e3f1496d2a 2023-08-11 05:58:37,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 58f613c4158957056d1242e3f1496d2a 2023-08-11 05:58:37,575 INFO [StoreOpener-58f613c4158957056d1242e3f1496d2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 58f613c4158957056d1242e3f1496d2a 2023-08-11 05:58:37,577 DEBUG [StoreOpener-58f613c4158957056d1242e3f1496d2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info 2023-08-11 05:58:37,577 DEBUG [StoreOpener-58f613c4158957056d1242e3f1496d2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info 2023-08-11 05:58:37,578 INFO [StoreOpener-58f613c4158957056d1242e3f1496d2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58f613c4158957056d1242e3f1496d2a columnFamilyName info 2023-08-11 05:58:37,578 INFO [StoreOpener-58f613c4158957056d1242e3f1496d2a-1] regionserver.HStore(310): Store=58f613c4158957056d1242e3f1496d2a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:58:37,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a 2023-08-11 05:58:37,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a 2023-08-11 05:58:37,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 58f613c4158957056d1242e3f1496d2a 2023-08-11 05:58:37,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:58:37,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 58f613c4158957056d1242e3f1496d2a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=800255, jitterRate=0.017576977610588074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:58:37,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 58f613c4158957056d1242e3f1496d2a: 2023-08-11 05:58:37,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a., pid=11, masterSystemTime=1691733517562 2023-08-11 05:58:37,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:58:37,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:58:37,596 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=58f613c4158957056d1242e3f1496d2a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:37,596 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1691733517595"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691733517595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691733517595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691733517595"}]},"ts":"1691733517595"} 2023-08-11 05:58:37,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-11 05:58:37,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 58f613c4158957056d1242e3f1496d2a, server=jenkins-hbase4.apache.org,34839,1691733516007 in 189 msec 2023-08-11 05:58:37,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-11 05:58:37,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=58f613c4158957056d1242e3f1496d2a, ASSIGN in 348 msec 2023-08-11 05:58:37,604 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 05:58:37,604 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733517604"}]},"ts":"1691733517604"} 2023-08-11 05:58:37,606 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLED in hbase:meta 2023-08-11 05:58:37,608 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 05:58:37,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling in 411 msec 2023-08-11 05:58:41,590 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 05:58:41,590 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-08-11 05:58:42,510 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-11 05:58:42,536 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-11 05:58:42,536 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-11 05:58:42,537 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 05:58:47,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-11 05:58:47,204 INFO [Listener at localhost/36517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testCompactionRecordDoesntBlockRolling, procId: 9 completed 2023-08-11 05:58:47,207 DEBUG [Listener at localhost/36517] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:47,207 DEBUG [Listener at localhost/36517] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:58:47,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-11 05:58:47,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] procedure.ProcedureCoordinator(165): Submitting procedure hbase:namespace 2023-08-11 05:58:47,226 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase:namespace' 2023-08-11 05:58:47,226 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 05:58:47,227 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase:namespace' starting 'acquire' 2023-08-11 05:58:47,227 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase:namespace', kicking off acquire phase on members. 2023-08-11 05:58:47,227 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 05:58:47,227 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-11 05:58:47,229 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 05:58:47,229 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 05:58:47,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:58:47,230 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,230 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-11 05:58:47,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase:namespace 2023-08-11 05:58:47,230 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 05:58:47,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-11 05:58:47,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-11 05:58:47,231 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase:namespace 2023-08-11 05:58:47,232 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase:namespace 2023-08-11 05:58:47,233 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase:namespace' with timeout 60000ms 2023-08-11 05:58:47,233 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 05:58:47,233 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase:namespace' starting 'acquire' stage 2023-08-11 05:58:47,234 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-11 05:58:47,234 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-11 05:58:47,234 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:58:47,234 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. started... 2023-08-11 05:58:47,234 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 19f92cd607e4294f9d50c2a485b9d1db 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-11 05:58:47,248 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db/.tmp/info/ccd88eb27ffd4ae896f50f33ba78915c 2023-08-11 05:58:47,258 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db/.tmp/info/ccd88eb27ffd4ae896f50f33ba78915c as hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db/info/ccd88eb27ffd4ae896f50f33ba78915c 2023-08-11 05:58:47,265 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db/info/ccd88eb27ffd4ae896f50f33ba78915c, entries=2, sequenceid=6, filesize=4.8 K 2023-08-11 05:58:47,266 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 19f92cd607e4294f9d50c2a485b9d1db in 32ms, sequenceid=6, compaction requested=false 2023-08-11 05:58:47,267 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 19f92cd607e4294f9d50c2a485b9d1db: 2023-08-11 05:58:47,267 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:58:47,267 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-11 05:58:47,267 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-11 05:58:47,267 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,267 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase:namespace' locally acquired 2023-08-11 05:58:47,267 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1691733516007' joining acquired barrier for procedure (hbase:namespace) in zk 2023-08-11 05:58:47,269 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,269 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 05:58:47,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:58:47,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:58:47,270 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 05:58:47,270 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase:namespace' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-11 05:58:47,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:58:47,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:58:47,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-11 05:58:47,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:58:47,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1691733516007' joining acquired barrier for procedure 'hbase:namespace' on coordinator 2023-08-11 05:58:47,271 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase:namespace' starting 'in-barrier' execution. 2023-08-11 05:58:47,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30678bdf[Count = 0] remaining members to acquire global barrier 2023-08-11 05:58:47,272 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 05:58:47,274 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 05:58:47,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 05:58:47,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 05:58:47,274 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase:namespace' received 'reached' from coordinator. 2023-08-11 05:58:47,274 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase:namespace' locally completed 2023-08-11 05:58:47,274 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase:namespace' completed for member 'jenkins-hbase4.apache.org,34839,1691733516007' in zk 2023-08-11 05:58:47,274 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,274 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-11 05:58:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase:namespace' has notified controller of completion 2023-08-11 05:58:47,276 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 05:58:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:58:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:58:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase:namespace' completed. 2023-08-11 05:58:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:58:47,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:58:47,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-11 05:58:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:58:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-11 05:58:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase:namespace' member 'jenkins-hbase4.apache.org,34839,1691733516007': 2023-08-11 05:58:47,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1691733516007' released barrier for procedure'hbase:namespace', counting down latch. Waiting for 0 more 2023-08-11 05:58:47,279 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase:namespace' execution completed 2023-08-11 05:58:47,279 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-11 05:58:47,279 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-11 05:58:47,279 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase:namespace 2023-08-11 05:58:47,279 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase:namespaceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-11 05:58:47,282 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 05:58:47,282 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 05:58:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 05:58:47,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 05:58:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:58:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:58:47,282 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 05:58:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 05:58:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:58:47,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 05:58:47,283 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:58:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-11 05:58:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 05:58:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:58:47,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-11 05:58:47,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,284 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:58:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-08-11 05:58:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,290 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,290 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 05:58:47,290 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-11 05:58:47,290 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-08-11 05:58:47,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 05:58:47,290 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 05:58:47,290 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:47,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase:namespace' 2023-08-11 05:58:47,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:58:47,290 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 05:58:47,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-11 05:58:47,291 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 05:58:47,291 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-08-11 05:58:47,291 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-08-11 05:58:47,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 05:58:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:58:47,293 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase:namespace'' to complete. (max 20000 ms per retry) 2023-08-11 05:58:47,293 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-11 05:58:57,293 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-11 05:58:57,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-11 05:58:57,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-11 05:58:57,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,312 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 05:58:57,312 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 05:58:57,312 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-11 05:58:57,312 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-11 05:58:57,313 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,313 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,315 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 05:58:57,315 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 05:58:57,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:58:57,315 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,315 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-11 05:58:57,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-11 05:58:57,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,316 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-11 05:58:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 05:58:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-11 05:58:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-11 05:58:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-11 05:58:57,317 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:58:57,317 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. started... 2023-08-11 05:58:57,318 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 58f613c4158957056d1242e3f1496d2a 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-11 05:58:57,334 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/.tmp/info/f6a74572160d452e9b2dcdf4578028d9 2023-08-11 05:58:57,345 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/.tmp/info/f6a74572160d452e9b2dcdf4578028d9 as hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f6a74572160d452e9b2dcdf4578028d9 2023-08-11 05:58:57,351 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f6a74572160d452e9b2dcdf4578028d9, entries=1, sequenceid=5, filesize=5.8 K 2023-08-11 05:58:57,353 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 58f613c4158957056d1242e3f1496d2a in 35ms, sequenceid=5, compaction requested=false 2023-08-11 05:58:57,353 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 58f613c4158957056d1242e3f1496d2a: 2023-08-11 05:58:57,353 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:58:57,353 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-11 05:58:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-11 05:58:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-11 05:58:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1691733516007' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-11 05:58:57,356 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,356 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:58:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:58:57,356 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,356 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-11 05:58:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:58:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:58:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:58:57,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1691733516007' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-11 05:58:57,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3458190b[Count = 0] remaining members to acquire global barrier 2023-08-11 05:58:57,358 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-11 05:58:57,358 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,360 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,360 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-11 05:58:57,360 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-11 05:58:57,360 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,360 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-11 05:58:57,360 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,34839,1691733516007' in zk 2023-08-11 05:58:57,362 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-11 05:58:57,362 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,362 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 05:58:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:58:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:58:57,362 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-11 05:58:57,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:58:57,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:58:57,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:58:57,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,34839,1691733516007': 2023-08-11 05:58:57,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1691733516007' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-11 05:58:57,365 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-11 05:58:57,365 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-11 05:58:57,365 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-11 05:58:57,366 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,366 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-11 05:58:57,370 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,370 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:58:57,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:58:57,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,370 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 05:58:57,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:58:57,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 05:58:57,371 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:58:57,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:58:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,372 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:58:57,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,376 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,376 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 05:58:57,376 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 05:58:57,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:58:57,376 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 05:58:57,376 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 05:58:57,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-11 05:58:57,376 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 05:58:57,377 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:58:57,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-11 05:58:57,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 05:58:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:58:57,377 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,377 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,377 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:58:57,377 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-11 05:58:57,378 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-11 05:59:07,378 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-11 05:59:07,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-11 05:59:07,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-11 05:59:07,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-11 05:59:07,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,389 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 05:59:07,389 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 05:59:07,389 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-11 05:59:07,389 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-11 05:59:07,390 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,390 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,391 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 05:59:07,391 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 05:59:07,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:59:07,392 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,392 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-11 05:59:07,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-11 05:59:07,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,393 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,393 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-11 05:59:07,393 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,393 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-11 05:59:07,393 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 05:59:07,394 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-11 05:59:07,394 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-11 05:59:07,394 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-11 05:59:07,394 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:59:07,394 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. started... 2023-08-11 05:59:07,394 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 58f613c4158957056d1242e3f1496d2a 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-11 05:59:07,408 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/.tmp/info/6111a2fd7c9c43a0b5d282b4d28d1608 2023-08-11 05:59:07,416 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/.tmp/info/6111a2fd7c9c43a0b5d282b4d28d1608 as hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/6111a2fd7c9c43a0b5d282b4d28d1608 2023-08-11 05:59:07,422 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/6111a2fd7c9c43a0b5d282b4d28d1608, entries=1, sequenceid=9, filesize=5.8 K 2023-08-11 05:59:07,423 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 58f613c4158957056d1242e3f1496d2a in 29ms, sequenceid=9, compaction requested=false 2023-08-11 05:59:07,423 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 58f613c4158957056d1242e3f1496d2a: 2023-08-11 05:59:07,424 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:59:07,424 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-11 05:59:07,424 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-11 05:59:07,424 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,424 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-11 05:59:07,424 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1691733516007' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-11 05:59:07,426 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,426 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:59:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:59:07,426 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,426 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-11 05:59:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:59:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:59:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:59:07,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1691733516007' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-11 05:59:07,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@715a81e4[Count = 0] remaining members to acquire global barrier 2023-08-11 05:59:07,428 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-11 05:59:07,428 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,429 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,430 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-11 05:59:07,430 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-11 05:59:07,430 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,34839,1691733516007' in zk 2023-08-11 05:59:07,430 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,430 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-11 05:59:07,432 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,432 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-11 05:59:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:59:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:59:07,432 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 05:59:07,433 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-11 05:59:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:59:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:59:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:59:07,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,34839,1691733516007': 2023-08-11 05:59:07,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1691733516007' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-11 05:59:07,436 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-11 05:59:07,436 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-11 05:59:07,436 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-11 05:59:07,436 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,436 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-11 05:59:07,437 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,437 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:59:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:59:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,437 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 05:59:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:59:07,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 05:59:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:59:07,438 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:59:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,440 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:59:07,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,442 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,442 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,442 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 05:59:07,442 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 05:59:07,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-11 05:59:07,442 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:07,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-08-11 05:59:07,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 05:59:07,442 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 05:59:07,442 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 05:59:07,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:59:07,442 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,443 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-11 05:59:07,443 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-11 05:59:07,443 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,443 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:07,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 05:59:07,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:59:17,443 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-11 05:59:17,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-11 05:59:17,464 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34603,DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0,DISK] 2023-08-11 05:59:17,464 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36827,DS-c67752e3-1efe-4237-b61a-290e8897ff79,DISK] 2023-08-11 05:59:17,467 INFO [Listener at localhost/36517] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733516408 with entries=13, filesize=6.36 KB; new WAL /user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733557447 2023-08-11 05:59:17,468 DEBUG [Listener at localhost/36517] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36827,DS-c67752e3-1efe-4237-b61a-290e8897ff79,DISK], DatanodeInfoWithStorage[127.0.0.1:34603,DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0,DISK]] 2023-08-11 05:59:17,468 DEBUG [Listener at localhost/36517] wal.AbstractFSWAL(716): hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733516408 is not closed yet, will try archiving it next time 2023-08-11 05:59:17,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-11 05:59:17,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-11 05:59:17,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,476 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 05:59:17,476 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 05:59:17,476 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-11 05:59:17,476 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-11 05:59:17,477 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,477 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,478 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 05:59:17,478 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 05:59:17,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:59:17,478 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,479 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-11 05:59:17,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-11 05:59:17,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,479 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,479 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-11 05:59:17,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,480 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-11 05:59:17,480 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 05:59:17,480 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-11 05:59:17,480 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-11 05:59:17,480 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-11 05:59:17,480 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:59:17,480 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. started... 2023-08-11 05:59:17,480 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 58f613c4158957056d1242e3f1496d2a 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-11 05:59:17,491 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=13 (bloomFilter=true), to=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/.tmp/info/f136bd38aeb7403abdb049e4a0d0ffd2 2023-08-11 05:59:17,500 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/.tmp/info/f136bd38aeb7403abdb049e4a0d0ffd2 as hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f136bd38aeb7403abdb049e4a0d0ffd2 2023-08-11 05:59:17,506 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f136bd38aeb7403abdb049e4a0d0ffd2, entries=1, sequenceid=13, filesize=5.8 K 2023-08-11 05:59:17,507 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 58f613c4158957056d1242e3f1496d2a in 27ms, sequenceid=13, compaction requested=true 2023-08-11 05:59:17,507 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 58f613c4158957056d1242e3f1496d2a: 2023-08-11 05:59:17,507 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:59:17,507 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-11 05:59:17,507 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-11 05:59:17,507 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,507 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-11 05:59:17,507 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1691733516007' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-11 05:59:17,510 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,510 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:59:17,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:59:17,510 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,511 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-11 05:59:17,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:59:17,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:59:17,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:59:17,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1691733516007' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-11 05:59:17,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c54061e[Count = 0] remaining members to acquire global barrier 2023-08-11 05:59:17,512 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-11 05:59:17,512 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,514 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,514 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-11 05:59:17,514 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-11 05:59:17,514 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,34839,1691733516007' in zk 2023-08-11 05:59:17,514 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,514 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-11 05:59:17,516 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,516 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-11 05:59:17,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:59:17,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:59:17,516 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 05:59:17,516 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-11 05:59:17,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:59:17,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:59:17,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:59:17,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,34839,1691733516007': 2023-08-11 05:59:17,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1691733516007' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-11 05:59:17,518 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-11 05:59:17,519 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-11 05:59:17,519 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-11 05:59:17,519 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,519 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-11 05:59:17,520 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,520 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:59:17,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:59:17,520 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 05:59:17,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:59:17,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 05:59:17,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:59:17,521 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:59:17,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,522 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:59:17,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,526 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,526 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 05:59:17,526 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 05:59:17,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 05:59:17,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-11 05:59:17,526 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 05:59:17,526 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,526 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 05:59:17,527 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:17,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:59:17,527 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,527 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-11 05:59:17,527 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-11 05:59:17,527 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:17,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 05:59:17,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:59:17,527 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,527 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-11 05:59:27,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-11 05:59:27,529 DEBUG [Listener at localhost/36517] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 05:59:27,535 DEBUG [Listener at localhost/36517] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 17694 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 05:59:27,536 DEBUG [Listener at localhost/36517] regionserver.HStore(1912): 58f613c4158957056d1242e3f1496d2a/info is initiating minor compaction (all files) 2023-08-11 05:59:27,536 INFO [Listener at localhost/36517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-11 05:59:27,537 INFO [Listener at localhost/36517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:27,537 INFO [Listener at localhost/36517] regionserver.HRegion(2259): Starting compaction of 58f613c4158957056d1242e3f1496d2a/info in TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:59:27,537 INFO [Listener at localhost/36517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f6a74572160d452e9b2dcdf4578028d9, hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/6111a2fd7c9c43a0b5d282b4d28d1608, hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f136bd38aeb7403abdb049e4a0d0ffd2] into tmpdir=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/.tmp, totalSize=17.3 K 2023-08-11 05:59:27,538 DEBUG [Listener at localhost/36517] compactions.Compactor(207): Compacting f6a74572160d452e9b2dcdf4578028d9, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1691733537304 2023-08-11 05:59:27,538 DEBUG [Listener at localhost/36517] compactions.Compactor(207): Compacting 6111a2fd7c9c43a0b5d282b4d28d1608, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1691733547380 2023-08-11 05:59:27,539 DEBUG [Listener at localhost/36517] compactions.Compactor(207): Compacting f136bd38aeb7403abdb049e4a0d0ffd2, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1691733557446 2023-08-11 05:59:27,560 INFO [Listener at localhost/36517] throttle.PressureAwareThroughputController(145): 58f613c4158957056d1242e3f1496d2a#info#compaction#9 average throughput is 3.01 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 05:59:27,578 DEBUG [Listener at localhost/36517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/.tmp/info/73e61dffb1a544d88f675fdac6299ded as hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/73e61dffb1a544d88f675fdac6299ded 2023-08-11 05:59:27,591 INFO [Listener at localhost/36517] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 58f613c4158957056d1242e3f1496d2a/info of 58f613c4158957056d1242e3f1496d2a into 73e61dffb1a544d88f675fdac6299ded(size=7.9 K), total size for store is 7.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 05:59:27,591 DEBUG [Listener at localhost/36517] regionserver.HRegion(2289): Compaction status journal for 58f613c4158957056d1242e3f1496d2a: 2023-08-11 05:59:27,607 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34603,DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0,DISK] 2023-08-11 05:59:27,608 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36827,DS-c67752e3-1efe-4237-b61a-290e8897ff79,DISK] 2023-08-11 05:59:27,610 INFO [Listener at localhost/36517] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733557447 with entries=4, filesize=2.43 KB; new WAL /user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733567593 2023-08-11 05:59:27,610 DEBUG [Listener at localhost/36517] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34603,DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0,DISK], DatanodeInfoWithStorage[127.0.0.1:36827,DS-c67752e3-1efe-4237-b61a-290e8897ff79,DISK]] 2023-08-11 05:59:27,610 DEBUG [Listener at localhost/36517] wal.AbstractFSWAL(716): hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733557447 is not closed yet, will try archiving it next time 2023-08-11 05:59:27,610 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733516408 to hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/oldWALs/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733516408 2023-08-11 05:59:27,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-08-11 05:59:27,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-08-11 05:59:27,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,618 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 05:59:27,618 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 05:59:27,618 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-08-11 05:59:27,618 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-08-11 05:59:27,619 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,619 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,622 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 05:59:27,622 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 05:59:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:59:27,623 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,623 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-08-11 05:59:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-08-11 05:59:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,624 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,624 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-08-11 05:59:27,624 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,624 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-08-11 05:59:27,624 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-08-11 05:59:27,624 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-08-11 05:59:27,625 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-08-11 05:59:27,625 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-08-11 05:59:27,625 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:59:27,625 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. started... 2023-08-11 05:59:27,625 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 58f613c4158957056d1242e3f1496d2a 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-11 05:59:27,638 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=18 (bloomFilter=true), to=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/.tmp/info/f6f6654229024feea01c58264ab8950f 2023-08-11 05:59:27,645 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/.tmp/info/f6f6654229024feea01c58264ab8950f as hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f6f6654229024feea01c58264ab8950f 2023-08-11 05:59:27,651 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f6f6654229024feea01c58264ab8950f, entries=1, sequenceid=18, filesize=5.8 K 2023-08-11 05:59:27,652 INFO [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 58f613c4158957056d1242e3f1496d2a in 27ms, sequenceid=18, compaction requested=false 2023-08-11 05:59:27,652 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 58f613c4158957056d1242e3f1496d2a: 2023-08-11 05:59:27,652 DEBUG [rs(jenkins-hbase4.apache.org,34839,1691733516007)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:59:27,652 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-08-11 05:59:27,653 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-08-11 05:59:27,653 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,653 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-08-11 05:59:27,653 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1691733516007' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-08-11 05:59:27,655 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,655 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:59:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:59:27,655 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,655 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-08-11 05:59:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:59:27,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:59:27,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:59:27,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1691733516007' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-08-11 05:59:27,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40e15538[Count = 0] remaining members to acquire global barrier 2023-08-11 05:59:27,657 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-08-11 05:59:27,657 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,662 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,662 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-08-11 05:59:27,662 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-08-11 05:59:27,662 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase4.apache.org,34839,1691733516007' in zk 2023-08-11 05:59:27,662 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,662 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-08-11 05:59:27,663 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-08-11 05:59:27,663 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 05:59:27,663 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,663 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1691733516007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-08-11 05:59:27,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:59:27,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:59:27,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:59:27,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:59:27,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:59:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase4.apache.org,34839,1691733516007': 2023-08-11 05:59:27,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1691733516007' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-08-11 05:59:27,667 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-08-11 05:59:27,667 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-08-11 05:59:27,667 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-08-11 05:59:27,667 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,667 INFO [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-08-11 05:59:27,669 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,669 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,669 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 05:59:27,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-08-11 05:59:27,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-08-11 05:59:27,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-08-11 05:59:27,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 05:59:27,670 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:59:27,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-08-11 05:59:27,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,672 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-08-11 05:59:27,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,675 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,675 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,675 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-08-11 05:59:27,675 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-08-11 05:59:27,675 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,675 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:27,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-08-11 05:59:27,675 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:59:27,675 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,675 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-08-11 05:59:27,675 DEBUG [(jenkins-hbase4.apache.org,36579,1691733515962)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-08-11 05:59:27,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-08-11 05:59:27,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-08-11 05:59:27,676 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-08-11 05:59:27,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-08-11 05:59:27,677 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-08-11 05:59:27,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:59:37,677 DEBUG [Listener at localhost/36517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-08-11 05:59:37,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36579] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-08-11 05:59:37,696 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34603,DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0,DISK] 2023-08-11 05:59:37,696 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36827,DS-c67752e3-1efe-4237-b61a-290e8897ff79,DISK] 2023-08-11 05:59:37,698 INFO [Listener at localhost/36517] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733567593 with entries=3, filesize=1.94 KB; new WAL /user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733577681 2023-08-11 05:59:37,698 DEBUG [Listener at localhost/36517] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34603,DS-86275707-b24f-4d7a-8b0c-cfa490dcb5d0,DISK], DatanodeInfoWithStorage[127.0.0.1:36827,DS-c67752e3-1efe-4237-b61a-290e8897ff79,DISK]] 2023-08-11 05:59:37,698 DEBUG [Listener at localhost/36517] wal.AbstractFSWAL(716): hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733567593 is not closed yet, will try archiving it next time 2023-08-11 05:59:37,699 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-11 05:59:37,699 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/WALs/jenkins-hbase4.apache.org,34839,1691733516007/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733557447 to hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/oldWALs/jenkins-hbase4.apache.org%2C34839%2C1691733516007.1691733557447 2023-08-11 05:59:37,699 INFO [Listener at localhost/36517] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-11 05:59:37,699 DEBUG [Listener at localhost/36517] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x411f5a54 to 127.0.0.1:63751 2023-08-11 05:59:37,700 DEBUG [Listener at localhost/36517] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:59:37,700 DEBUG [Listener at localhost/36517] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-11 05:59:37,700 DEBUG [Listener at localhost/36517] util.JVMClusterUtil(257): Found active master hash=292345708, stopped=false 2023-08-11 05:59:37,700 INFO [Listener at localhost/36517] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36579,1691733515962 2023-08-11 05:59:37,702 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 05:59:37,702 INFO [Listener at localhost/36517] procedure2.ProcedureExecutor(629): Stopping 2023-08-11 05:59:37,702 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 05:59:37,702 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:59:37,702 DEBUG [Listener at localhost/36517] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13c69b5b to 127.0.0.1:63751 2023-08-11 05:59:37,703 DEBUG [Listener at localhost/36517] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:59:37,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:59:37,703 INFO [Listener at localhost/36517] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34839,1691733516007' ***** 2023-08-11 05:59:37,703 INFO [Listener at localhost/36517] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-11 05:59:37,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:59:37,703 INFO [RS:0;jenkins-hbase4:34839] regionserver.HeapMemoryManager(220): Stopping 2023-08-11 05:59:37,703 INFO [RS:0;jenkins-hbase4:34839] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-11 05:59:37,703 INFO [RS:0;jenkins-hbase4:34839] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-11 05:59:37,703 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-11 05:59:37,703 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(3305): Received CLOSE for 58f613c4158957056d1242e3f1496d2a 2023-08-11 05:59:37,704 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(3305): Received CLOSE for 19f92cd607e4294f9d50c2a485b9d1db 2023-08-11 05:59:37,704 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:37,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 58f613c4158957056d1242e3f1496d2a, disabling compactions & flushes 2023-08-11 05:59:37,704 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e9caec5 to 127.0.0.1:63751 2023-08-11 05:59:37,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:59:37,704 DEBUG [RS:0;jenkins-hbase4:34839] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:59:37,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:59:37,704 INFO [RS:0;jenkins-hbase4:34839] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-11 05:59:37,704 INFO [RS:0;jenkins-hbase4:34839] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-11 05:59:37,704 INFO [RS:0;jenkins-hbase4:34839] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-11 05:59:37,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. after waiting 0 ms 2023-08-11 05:59:37,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:59:37,705 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-11 05:59:37,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 58f613c4158957056d1242e3f1496d2a 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-08-11 05:59:37,705 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-08-11 05:59:37,705 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1478): Online Regions={58f613c4158957056d1242e3f1496d2a=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a., 1588230740=hbase:meta,,1.1588230740, 19f92cd607e4294f9d50c2a485b9d1db=hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db.} 2023-08-11 05:59:37,706 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1504): Waiting on 1588230740, 19f92cd607e4294f9d50c2a485b9d1db, 58f613c4158957056d1242e3f1496d2a 2023-08-11 05:59:37,706 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 05:59:37,706 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 05:59:37,706 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 05:59:37,706 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 05:59:37,706 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 05:59:37,706 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.10 KB heapSize=5.61 KB 2023-08-11 05:59:37,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=22 (bloomFilter=true), to=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/.tmp/info/d3ffe42e18a748a99266b48da2b7f113 2023-08-11 05:59:37,725 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.84 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/.tmp/info/b5525541c5144f188ecb9c867f673afe 2023-08-11 05:59:37,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/.tmp/info/d3ffe42e18a748a99266b48da2b7f113 as hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/d3ffe42e18a748a99266b48da2b7f113 2023-08-11 05:59:37,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/d3ffe42e18a748a99266b48da2b7f113, entries=1, sequenceid=22, filesize=5.8 K 2023-08-11 05:59:37,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 58f613c4158957056d1242e3f1496d2a in 36ms, sequenceid=22, compaction requested=true 2023-08-11 05:59:37,746 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f6a74572160d452e9b2dcdf4578028d9, hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/6111a2fd7c9c43a0b5d282b4d28d1608, hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f136bd38aeb7403abdb049e4a0d0ffd2] to archive 2023-08-11 05:59:37,746 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=264 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/.tmp/table/7828c17215d34e2985414e3aedf12718 2023-08-11 05:59:37,747 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-11 05:59:37,751 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f6a74572160d452e9b2dcdf4578028d9 to hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f6a74572160d452e9b2dcdf4578028d9 2023-08-11 05:59:37,752 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/6111a2fd7c9c43a0b5d282b4d28d1608 to hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/6111a2fd7c9c43a0b5d282b4d28d1608 2023-08-11 05:59:37,755 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f136bd38aeb7403abdb049e4a0d0ffd2 to hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/info/f136bd38aeb7403abdb049e4a0d0ffd2 2023-08-11 05:59:37,756 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/.tmp/info/b5525541c5144f188ecb9c867f673afe as hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/info/b5525541c5144f188ecb9c867f673afe 2023-08-11 05:59:37,762 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/info/b5525541c5144f188ecb9c867f673afe, entries=20, sequenceid=14, filesize=7.6 K 2023-08-11 05:59:37,763 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/.tmp/table/7828c17215d34e2985414e3aedf12718 as hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/table/7828c17215d34e2985414e3aedf12718 2023-08-11 05:59:37,768 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/table/7828c17215d34e2985414e3aedf12718, entries=4, sequenceid=14, filesize=4.9 K 2023-08-11 05:59:37,769 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.10 KB/3174, heapSize ~5.33 KB/5456, currentSize=0 B/0 for 1588230740 in 63ms, sequenceid=14, compaction requested=false 2023-08-11 05:59:37,775 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-08-11 05:59:37,776 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 05:59:37,777 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 05:59:37,777 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 05:59:37,777 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-11 05:59:37,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/58f613c4158957056d1242e3f1496d2a/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2023-08-11 05:59:37,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:59:37,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 58f613c4158957056d1242e3f1496d2a: 2023-08-11 05:59:37,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1691733517196.58f613c4158957056d1242e3f1496d2a. 2023-08-11 05:59:37,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 19f92cd607e4294f9d50c2a485b9d1db, disabling compactions & flushes 2023-08-11 05:59:37,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:59:37,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:59:37,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. after waiting 0 ms 2023-08-11 05:59:37,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:59:37,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/data/hbase/namespace/19f92cd607e4294f9d50c2a485b9d1db/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-11 05:59:37,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:59:37,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 19f92cd607e4294f9d50c2a485b9d1db: 2023-08-11 05:59:37,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1691733516639.19f92cd607e4294f9d50c2a485b9d1db. 2023-08-11 05:59:37,906 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34839,1691733516007; all regions closed. 2023-08-11 05:59:37,912 DEBUG [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/oldWALs 2023-08-11 05:59:37,912 INFO [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34839%2C1691733516007.meta:.meta(num 1691733516572) 2023-08-11 05:59:37,917 DEBUG [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(1028): Moved 2 WAL file(s) to /user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/oldWALs 2023-08-11 05:59:37,918 INFO [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34839%2C1691733516007:(num 1691733577681) 2023-08-11 05:59:37,918 DEBUG [RS:0;jenkins-hbase4:34839] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:59:37,918 INFO [RS:0;jenkins-hbase4:34839] regionserver.LeaseManager(133): Closed leases 2023-08-11 05:59:37,918 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-11 05:59:37,918 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 05:59:37,919 INFO [RS:0;jenkins-hbase4:34839] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34839 2023-08-11 05:59:37,922 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34839,1691733516007 2023-08-11 05:59:37,922 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 05:59:37,922 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 05:59:37,924 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34839,1691733516007] 2023-08-11 05:59:37,924 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34839,1691733516007; numProcessing=1 2023-08-11 05:59:37,925 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34839,1691733516007 already deleted, retry=false 2023-08-11 05:59:37,925 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34839,1691733516007 expired; onlineServers=0 2023-08-11 05:59:37,925 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36579,1691733515962' ***** 2023-08-11 05:59:37,925 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-11 05:59:37,925 DEBUG [M:0;jenkins-hbase4:36579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15535199, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 05:59:37,925 INFO [M:0;jenkins-hbase4:36579] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36579,1691733515962 2023-08-11 05:59:37,925 INFO [M:0;jenkins-hbase4:36579] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36579,1691733515962; all regions closed. 2023-08-11 05:59:37,925 DEBUG [M:0;jenkins-hbase4:36579] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 05:59:37,926 DEBUG [M:0;jenkins-hbase4:36579] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-11 05:59:37,926 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-11 05:59:37,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691733516196] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691733516196,5,FailOnTimeoutGroup] 2023-08-11 05:59:37,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691733516196] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691733516196,5,FailOnTimeoutGroup] 2023-08-11 05:59:37,926 DEBUG [M:0;jenkins-hbase4:36579] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-11 05:59:37,926 INFO [M:0;jenkins-hbase4:36579] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-11 05:59:37,926 INFO [M:0;jenkins-hbase4:36579] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-11 05:59:37,927 INFO [M:0;jenkins-hbase4:36579] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-11 05:59:37,927 DEBUG [M:0;jenkins-hbase4:36579] master.HMaster(1512): Stopping service threads 2023-08-11 05:59:37,927 INFO [M:0;jenkins-hbase4:36579] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-11 05:59:37,927 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-11 05:59:37,927 ERROR [M:0;jenkins-hbase4:36579] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-08-11 05:59:37,927 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:59:37,927 INFO [M:0;jenkins-hbase4:36579] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-11 05:59:37,927 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-11 05:59:37,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 05:59:37,928 DEBUG [M:0;jenkins-hbase4:36579] zookeeper.ZKUtil(398): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-11 05:59:37,928 WARN [M:0;jenkins-hbase4:36579] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-11 05:59:37,928 INFO [M:0;jenkins-hbase4:36579] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-11 05:59:37,928 INFO [M:0;jenkins-hbase4:36579] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-11 05:59:37,928 DEBUG [M:0;jenkins-hbase4:36579] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 05:59:37,928 INFO [M:0;jenkins-hbase4:36579] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:59:37,928 DEBUG [M:0;jenkins-hbase4:36579] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:59:37,928 DEBUG [M:0;jenkins-hbase4:36579] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 05:59:37,929 DEBUG [M:0;jenkins-hbase4:36579] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:59:37,929 INFO [M:0;jenkins-hbase4:36579] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.89 KB heapSize=47.33 KB 2023-08-11 05:59:37,941 INFO [M:0;jenkins-hbase4:36579] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.89 KB at sequenceid=100 (bloomFilter=true), to=hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/505008ae3ab74be1a41eabcb81d19489 2023-08-11 05:59:37,947 INFO [M:0;jenkins-hbase4:36579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 505008ae3ab74be1a41eabcb81d19489 2023-08-11 05:59:37,948 DEBUG [M:0;jenkins-hbase4:36579] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/505008ae3ab74be1a41eabcb81d19489 as hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/505008ae3ab74be1a41eabcb81d19489 2023-08-11 05:59:37,953 INFO [M:0;jenkins-hbase4:36579] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 505008ae3ab74be1a41eabcb81d19489 2023-08-11 05:59:37,953 INFO [M:0;jenkins-hbase4:36579] regionserver.HStore(1080): Added hdfs://localhost:44391/user/jenkins/test-data/4ced735d-029f-1e39-8989-e36991040675/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/505008ae3ab74be1a41eabcb81d19489, entries=11, sequenceid=100, filesize=6.1 K 2023-08-11 05:59:37,954 INFO [M:0;jenkins-hbase4:36579] regionserver.HRegion(2948): Finished flush of dataSize ~38.89 KB/39824, heapSize ~47.31 KB/48448, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=100, compaction requested=false 2023-08-11 05:59:37,955 INFO [M:0;jenkins-hbase4:36579] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:59:37,955 DEBUG [M:0;jenkins-hbase4:36579] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 05:59:37,958 INFO [M:0;jenkins-hbase4:36579] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-11 05:59:37,958 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 05:59:37,959 INFO [M:0;jenkins-hbase4:36579] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36579 2023-08-11 05:59:37,962 DEBUG [M:0;jenkins-hbase4:36579] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36579,1691733515962 already deleted, retry=false 2023-08-11 05:59:38,024 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:59:38,024 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34839,1691733516007; zookeeper connection closed. 2023-08-11 05:59:38,024 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101f29b61a80001, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:59:38,025 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5ce66a11] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5ce66a11 2023-08-11 05:59:38,025 INFO [Listener at localhost/36517] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-11 05:59:38,124 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:59:38,124 INFO [M:0;jenkins-hbase4:36579] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36579,1691733515962; zookeeper connection closed. 2023-08-11 05:59:38,124 DEBUG [Listener at localhost/36517-EventThread] zookeeper.ZKWatcher(600): master:36579-0x101f29b61a80000, quorum=127.0.0.1:63751, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 05:59:38,125 WARN [Listener at localhost/36517] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 05:59:38,128 INFO [Listener at localhost/36517] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:59:38,233 WARN [BP-521165414-172.31.14.131-1691733515385 heartbeating to localhost/127.0.0.1:44391] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 05:59:38,233 WARN [BP-521165414-172.31.14.131-1691733515385 heartbeating to localhost/127.0.0.1:44391] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-521165414-172.31.14.131-1691733515385 (Datanode Uuid d4196803-1d1e-45f6-b06d-798356d7fe94) service to localhost/127.0.0.1:44391 2023-08-11 05:59:38,233 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/cluster_1e106661-9bb2-c9ba-eca8-9c6819f6b0a8/dfs/data/data3/current/BP-521165414-172.31.14.131-1691733515385] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:59:38,234 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/cluster_1e106661-9bb2-c9ba-eca8-9c6819f6b0a8/dfs/data/data4/current/BP-521165414-172.31.14.131-1691733515385] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:59:38,235 WARN [Listener at localhost/36517] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 05:59:38,239 INFO [Listener at localhost/36517] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:59:38,280 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-11 05:59:38,342 WARN [BP-521165414-172.31.14.131-1691733515385 heartbeating to localhost/127.0.0.1:44391] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 05:59:38,343 WARN [BP-521165414-172.31.14.131-1691733515385 heartbeating to localhost/127.0.0.1:44391] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-521165414-172.31.14.131-1691733515385 (Datanode Uuid aa4a436a-1811-43bc-bede-caa56d1dc200) service to localhost/127.0.0.1:44391 2023-08-11 05:59:38,343 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/cluster_1e106661-9bb2-c9ba-eca8-9c6819f6b0a8/dfs/data/data1/current/BP-521165414-172.31.14.131-1691733515385] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:59:38,344 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/cluster_1e106661-9bb2-c9ba-eca8-9c6819f6b0a8/dfs/data/data2/current/BP-521165414-172.31.14.131-1691733515385] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 05:59:38,354 INFO [Listener at localhost/36517] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 05:59:38,466 INFO [Listener at localhost/36517] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-11 05:59:38,482 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-11 05:59:38,492 INFO [Listener at localhost/36517] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=64 (was 78), OpenFileDescriptor=436 (was 467), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=85 (was 168), ProcessCount=171 (was 171), AvailableMemoryMB=2897 (was 3112) 2023-08-11 05:59:38,500 INFO [Listener at localhost/36517] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=65, OpenFileDescriptor=436, MaxFileDescriptor=60000, SystemLoadAverage=85, ProcessCount=171, AvailableMemoryMB=2897 2023-08-11 05:59:38,501 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-11 05:59:38,501 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/hadoop.log.dir so I do NOT create it in target/test-data/a9113558-e09e-303a-0a54-11097221d802 2023-08-11 05:59:38,501 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/16846d6f-bac8-973e-6da5-d1e1fc8001a4/hadoop.tmp.dir so I do NOT create it in target/test-data/a9113558-e09e-303a-0a54-11097221d802 2023-08-11 05:59:38,501 INFO [Listener at localhost/36517] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/cluster_68b6fc60-97df-e8da-54d2-fb3a5ba5f9fd, deleteOnExit=true 2023-08-11 05:59:38,501 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-11 05:59:38,502 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/test.cache.data in system properties and HBase conf 2023-08-11 05:59:38,502 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/hadoop.tmp.dir in system properties and HBase conf 2023-08-11 05:59:38,502 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/hadoop.log.dir in system properties and HBase conf 2023-08-11 05:59:38,502 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-11 05:59:38,502 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-11 05:59:38,503 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-11 05:59:38,503 DEBUG [Listener at localhost/36517] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-11 05:59:38,503 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-11 05:59:38,503 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-11 05:59:38,503 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-11 05:59:38,504 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 05:59:38,504 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-11 05:59:38,504 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-11 05:59:38,504 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 05:59:38,504 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 05:59:38,505 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-11 05:59:38,505 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/nfs.dump.dir in system properties and HBase conf 2023-08-11 05:59:38,505 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/java.io.tmpdir in system properties and HBase conf 2023-08-11 05:59:38,505 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 05:59:38,505 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-11 05:59:38,505 INFO [Listener at localhost/36517] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-11 05:59:38,510 WARN [Listener at localhost/36517] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 05:59:38,510 WARN [Listener at localhost/36517] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 05:59:38,549 WARN [Listener at localhost/36517] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:59:38,551 INFO [Listener at localhost/36517] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:59:38,556 INFO [Listener at localhost/36517] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/java.io.tmpdir/Jetty_localhost_44459_hdfs____43htz6/webapp 2023-08-11 05:59:38,649 INFO [Listener at localhost/36517] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44459 2023-08-11 05:59:38,653 WARN [Listener at localhost/36517] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 05:59:38,653 WARN [Listener at localhost/36517] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 05:59:38,690 WARN [Listener at localhost/39409] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:59:38,705 WARN [Listener at localhost/39409] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 05:59:38,707 WARN [Listener at localhost/39409] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:59:38,708 INFO [Listener at localhost/39409] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:59:38,713 INFO [Listener at localhost/39409] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/java.io.tmpdir/Jetty_localhost_37671_datanode____hv9toz/webapp 2023-08-11 05:59:38,805 INFO [Listener at localhost/39409] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37671 2023-08-11 05:59:38,811 WARN [Listener at localhost/44119] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:59:38,829 WARN [Listener at localhost/44119] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 05:59:38,831 WARN [Listener at localhost/44119] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 05:59:38,832 INFO [Listener at localhost/44119] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 05:59:38,835 INFO [Listener at localhost/44119] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/java.io.tmpdir/Jetty_localhost_39633_datanode____opz00n/webapp 2023-08-11 05:59:38,915 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8c937e79f86d7f1d: Processing first storage report for DS-0fa6580a-a0d6-4400-bacc-1283d3a90e58 from datanode 14c0f07f-defc-4512-b862-141a3a37ee13 2023-08-11 05:59:38,916 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8c937e79f86d7f1d: from storage DS-0fa6580a-a0d6-4400-bacc-1283d3a90e58 node DatanodeRegistration(127.0.0.1:33717, datanodeUuid=14c0f07f-defc-4512-b862-141a3a37ee13, infoPort=35137, infoSecurePort=0, ipcPort=44119, storageInfo=lv=-57;cid=testClusterID;nsid=867773663;c=1691733578513), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:59:38,916 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8c937e79f86d7f1d: Processing first storage report for DS-56e9d458-a1c7-4fa9-bdf2-22821b632127 from datanode 14c0f07f-defc-4512-b862-141a3a37ee13 2023-08-11 05:59:38,916 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8c937e79f86d7f1d: from storage DS-56e9d458-a1c7-4fa9-bdf2-22821b632127 node DatanodeRegistration(127.0.0.1:33717, datanodeUuid=14c0f07f-defc-4512-b862-141a3a37ee13, infoPort=35137, infoSecurePort=0, ipcPort=44119, storageInfo=lv=-57;cid=testClusterID;nsid=867773663;c=1691733578513), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:59:38,931 INFO [Listener at localhost/44119] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39633 2023-08-11 05:59:38,938 WARN [Listener at localhost/34697] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 05:59:39,031 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7013d283ff008a43: Processing first storage report for DS-c9721935-3327-4425-9403-cf02de7e1b8b from datanode 5e0765af-4de6-48f3-b5b5-88dc5b79d562 2023-08-11 05:59:39,031 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7013d283ff008a43: from storage DS-c9721935-3327-4425-9403-cf02de7e1b8b node DatanodeRegistration(127.0.0.1:34381, datanodeUuid=5e0765af-4de6-48f3-b5b5-88dc5b79d562, infoPort=41921, infoSecurePort=0, ipcPort=34697, storageInfo=lv=-57;cid=testClusterID;nsid=867773663;c=1691733578513), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-08-11 05:59:39,032 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7013d283ff008a43: Processing first storage report for DS-462cd1fd-9817-4c39-bbb6-81f6396c057c from datanode 5e0765af-4de6-48f3-b5b5-88dc5b79d562 2023-08-11 05:59:39,032 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7013d283ff008a43: from storage DS-462cd1fd-9817-4c39-bbb6-81f6396c057c node DatanodeRegistration(127.0.0.1:34381, datanodeUuid=5e0765af-4de6-48f3-b5b5-88dc5b79d562, infoPort=41921, infoSecurePort=0, ipcPort=34697, storageInfo=lv=-57;cid=testClusterID;nsid=867773663;c=1691733578513), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 05:59:39,055 DEBUG [Listener at localhost/34697] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802 2023-08-11 05:59:39,058 INFO [Listener at localhost/34697] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/cluster_68b6fc60-97df-e8da-54d2-fb3a5ba5f9fd/zookeeper_0, clientPort=57410, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/cluster_68b6fc60-97df-e8da-54d2-fb3a5ba5f9fd/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/cluster_68b6fc60-97df-e8da-54d2-fb3a5ba5f9fd/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-11 05:59:39,059 INFO [Listener at localhost/34697] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57410 2023-08-11 05:59:39,060 INFO [Listener at localhost/34697] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:59:39,061 INFO [Listener at localhost/34697] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:59:39,076 INFO [Listener at localhost/34697] util.FSUtils(471): Created version file at hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e with version=8 2023-08-11 05:59:39,076 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/hbase-staging 2023-08-11 05:59:39,079 INFO [Listener at localhost/34697] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 05:59:39,079 INFO [Listener at localhost/34697] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:59:39,079 INFO [Listener at localhost/34697] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 05:59:39,079 INFO [Listener at localhost/34697] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 05:59:39,079 INFO [Listener at localhost/34697] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:59:39,079 INFO [Listener at localhost/34697] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 05:59:39,080 INFO [Listener at localhost/34697] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 05:59:39,081 INFO [Listener at localhost/34697] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36765 2023-08-11 05:59:39,081 INFO [Listener at localhost/34697] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:59:39,082 INFO [Listener at localhost/34697] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:59:39,083 INFO [Listener at localhost/34697] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36765 connecting to ZooKeeper ensemble=127.0.0.1:57410 2023-08-11 05:59:39,090 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:367650x0, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 05:59:39,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36765-0x101f29c58340000 connected 2023-08-11 05:59:39,106 DEBUG [Listener at localhost/34697] zookeeper.ZKUtil(164): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 05:59:39,106 DEBUG [Listener at localhost/34697] zookeeper.ZKUtil(164): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:59:39,107 DEBUG [Listener at localhost/34697] zookeeper.ZKUtil(164): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 05:59:39,107 DEBUG [Listener at localhost/34697] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36765 2023-08-11 05:59:39,107 DEBUG [Listener at localhost/34697] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36765 2023-08-11 05:59:39,107 DEBUG [Listener at localhost/34697] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36765 2023-08-11 05:59:39,108 DEBUG [Listener at localhost/34697] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36765 2023-08-11 05:59:39,108 DEBUG [Listener at localhost/34697] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36765 2023-08-11 05:59:39,108 INFO [Listener at localhost/34697] master.HMaster(444): hbase.rootdir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e, hbase.cluster.distributed=false 2023-08-11 05:59:39,120 INFO [Listener at localhost/34697] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 05:59:39,121 INFO [Listener at localhost/34697] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:59:39,121 INFO [Listener at localhost/34697] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 05:59:39,121 INFO [Listener at localhost/34697] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 05:59:39,121 INFO [Listener at localhost/34697] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 05:59:39,121 INFO [Listener at localhost/34697] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 05:59:39,121 INFO [Listener at localhost/34697] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 05:59:39,122 INFO [Listener at localhost/34697] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40141 2023-08-11 05:59:39,123 INFO [Listener at localhost/34697] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-11 05:59:39,123 DEBUG [Listener at localhost/34697] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-11 05:59:39,124 INFO [Listener at localhost/34697] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:59:39,125 INFO [Listener at localhost/34697] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:59:39,126 INFO [Listener at localhost/34697] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40141 connecting to ZooKeeper ensemble=127.0.0.1:57410 2023-08-11 05:59:39,129 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): regionserver:401410x0, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 05:59:39,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40141-0x101f29c58340001 connected 2023-08-11 05:59:39,129 DEBUG [Listener at localhost/34697] zookeeper.ZKUtil(164): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 05:59:39,130 DEBUG [Listener at localhost/34697] zookeeper.ZKUtil(164): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 05:59:39,130 DEBUG [Listener at localhost/34697] zookeeper.ZKUtil(164): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 05:59:39,131 DEBUG [Listener at localhost/34697] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40141 2023-08-11 05:59:39,131 DEBUG [Listener at localhost/34697] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40141 2023-08-11 05:59:39,131 DEBUG [Listener at localhost/34697] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40141 2023-08-11 05:59:39,132 DEBUG [Listener at localhost/34697] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40141 2023-08-11 05:59:39,132 DEBUG [Listener at localhost/34697] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40141 2023-08-11 05:59:39,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36765,1691733579078 2023-08-11 05:59:39,134 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 05:59:39,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36765,1691733579078 2023-08-11 05:59:39,136 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 05:59:39,136 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 05:59:39,136 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:59:39,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 05:59:39,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36765,1691733579078 from backup master directory 2023-08-11 05:59:39,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 05:59:39,139 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36765,1691733579078 2023-08-11 05:59:39,139 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 05:59:39,139 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 05:59:39,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36765,1691733579078 2023-08-11 05:59:39,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/hbase.id with ID: be6b60d2-85f7-410c-9e27-5c415247d6b5 2023-08-11 05:59:39,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:59:39,169 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:59:39,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x731e1362 to 127.0.0.1:57410 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 05:59:39,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5240449e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 05:59:39,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 05:59:39,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-11 05:59:39,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:59:39,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/data/master/store-tmp 2023-08-11 05:59:39,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:59:39,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 05:59:39,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:59:39,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:59:39,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 05:59:39,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:59:39,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 05:59:39,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 05:59:39,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/WALs/jenkins-hbase4.apache.org,36765,1691733579078 2023-08-11 05:59:39,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36765%2C1691733579078, suffix=, logDir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/WALs/jenkins-hbase4.apache.org,36765,1691733579078, archiveDir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/oldWALs, maxLogs=10 2023-08-11 05:59:39,215 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33717,DS-0fa6580a-a0d6-4400-bacc-1283d3a90e58,DISK] 2023-08-11 05:59:39,215 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34381,DS-c9721935-3327-4425-9403-cf02de7e1b8b,DISK] 2023-08-11 05:59:39,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/WALs/jenkins-hbase4.apache.org,36765,1691733579078/jenkins-hbase4.apache.org%2C36765%2C1691733579078.1691733579200 2023-08-11 05:59:39,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33717,DS-0fa6580a-a0d6-4400-bacc-1283d3a90e58,DISK], DatanodeInfoWithStorage[127.0.0.1:34381,DS-c9721935-3327-4425-9403-cf02de7e1b8b,DISK]] 2023-08-11 05:59:39,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:59:39,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:59:39,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:59:39,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:59:39,220 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:59:39,221 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-11 05:59:39,222 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-11 05:59:39,222 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:59:39,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:59:39,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:59:39,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 05:59:39,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:59:39,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=877287, jitterRate=0.11552928388118744}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:59:39,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 05:59:39,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-11 05:59:39,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-11 05:59:39,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-11 05:59:39,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-11 05:59:39,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-11 05:59:39,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-11 05:59:39,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-11 05:59:39,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-11 05:59:39,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-11 05:59:39,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-11 05:59:39,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-11 05:59:39,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-11 05:59:39,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-11 05:59:39,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-11 05:59:39,246 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:59:39,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-11 05:59:39,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-11 05:59:39,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-11 05:59:39,251 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 05:59:39,251 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 05:59:39,251 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:59:39,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36765,1691733579078, sessionid=0x101f29c58340000, setting cluster-up flag (Was=false) 2023-08-11 05:59:39,254 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:59:39,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-11 05:59:39,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36765,1691733579078 2023-08-11 05:59:39,263 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:59:39,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-11 05:59:39,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36765,1691733579078 2023-08-11 05:59:39,269 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/.hbase-snapshot/.tmp 2023-08-11 05:59:39,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-11 05:59:39,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:59:39,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:59:39,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:59:39,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 05:59:39,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-11 05:59:39,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:59:39,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 05:59:39,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:59:39,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1691733609273 2023-08-11 05:59:39,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-11 05:59:39,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-11 05:59:39,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-11 05:59:39,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-11 05:59:39,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-11 05:59:39,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-11 05:59:39,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-11 05:59:39,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-11 05:59:39,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-11 05:59:39,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-11 05:59:39,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-11 05:59:39,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691733579274,5,FailOnTimeoutGroup] 2023-08-11 05:59:39,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691733579274,5,FailOnTimeoutGroup] 2023-08-11 05:59:39,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-11 05:59:39,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,276 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 05:59:39,276 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-11 05:59:39,277 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 05:59:39,290 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 05:59:39,291 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 05:59:39,291 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e 2023-08-11 05:59:39,302 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:59:39,303 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 05:59:39,305 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/info 2023-08-11 05:59:39,305 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 05:59:39,306 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:59:39,306 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 05:59:39,307 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/rep_barrier 2023-08-11 05:59:39,308 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 05:59:39,308 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:59:39,308 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 05:59:39,309 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/table 2023-08-11 05:59:39,310 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 05:59:39,310 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:59:39,311 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740 2023-08-11 05:59:39,312 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740 2023-08-11 05:59:39,314 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 05:59:39,315 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 05:59:39,317 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:59:39,318 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=738650, jitterRate=-0.060758039355278015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 05:59:39,318 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 05:59:39,318 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 05:59:39,318 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 05:59:39,318 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 05:59:39,318 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 05:59:39,318 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 05:59:39,318 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 05:59:39,318 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 05:59:39,319 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 05:59:39,319 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-11 05:59:39,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-11 05:59:39,321 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-11 05:59:39,322 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-11 05:59:39,333 INFO [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(951): ClusterId : be6b60d2-85f7-410c-9e27-5c415247d6b5 2023-08-11 05:59:39,334 DEBUG [RS:0;jenkins-hbase4:40141] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-11 05:59:39,336 DEBUG [RS:0;jenkins-hbase4:40141] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-11 05:59:39,336 DEBUG [RS:0;jenkins-hbase4:40141] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-11 05:59:39,338 DEBUG [RS:0;jenkins-hbase4:40141] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-11 05:59:39,339 DEBUG [RS:0;jenkins-hbase4:40141] zookeeper.ReadOnlyZKClient(139): Connect 0x1839d49a to 127.0.0.1:57410 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 05:59:39,342 DEBUG [RS:0;jenkins-hbase4:40141] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16fe39ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 05:59:39,342 DEBUG [RS:0;jenkins-hbase4:40141] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12c1bfea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 05:59:39,351 DEBUG [RS:0;jenkins-hbase4:40141] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40141 2023-08-11 05:59:39,351 INFO [RS:0;jenkins-hbase4:40141] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-11 05:59:39,351 INFO [RS:0;jenkins-hbase4:40141] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-11 05:59:39,351 DEBUG [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(1022): About to register with Master. 2023-08-11 05:59:39,352 INFO [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36765,1691733579078 with isa=jenkins-hbase4.apache.org/172.31.14.131:40141, startcode=1691733579120 2023-08-11 05:59:39,352 DEBUG [RS:0;jenkins-hbase4:40141] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-11 05:59:39,354 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59569, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-08-11 05:59:39,355 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36765] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 05:59:39,355 DEBUG [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e 2023-08-11 05:59:39,356 DEBUG [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39409 2023-08-11 05:59:39,356 DEBUG [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-11 05:59:39,357 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 05:59:39,357 DEBUG [RS:0;jenkins-hbase4:40141] zookeeper.ZKUtil(162): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 05:59:39,358 WARN [RS:0;jenkins-hbase4:40141] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 05:59:39,358 INFO [RS:0;jenkins-hbase4:40141] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:59:39,358 DEBUG [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 05:59:39,358 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40141,1691733579120] 2023-08-11 05:59:39,366 DEBUG [RS:0;jenkins-hbase4:40141] zookeeper.ZKUtil(162): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 05:59:39,367 DEBUG [RS:0;jenkins-hbase4:40141] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-11 05:59:39,367 INFO [RS:0;jenkins-hbase4:40141] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-11 05:59:39,369 INFO [RS:0;jenkins-hbase4:40141] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-11 05:59:39,370 INFO [RS:0;jenkins-hbase4:40141] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-11 05:59:39,370 INFO [RS:0;jenkins-hbase4:40141] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,370 INFO [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-11 05:59:39,372 INFO [RS:0;jenkins-hbase4:40141] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,372 DEBUG [RS:0;jenkins-hbase4:40141] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:59:39,372 DEBUG [RS:0;jenkins-hbase4:40141] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:59:39,372 DEBUG [RS:0;jenkins-hbase4:40141] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:59:39,372 DEBUG [RS:0;jenkins-hbase4:40141] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:59:39,372 DEBUG [RS:0;jenkins-hbase4:40141] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:59:39,372 DEBUG [RS:0;jenkins-hbase4:40141] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 05:59:39,372 DEBUG [RS:0;jenkins-hbase4:40141] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:59:39,372 DEBUG [RS:0;jenkins-hbase4:40141] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:59:39,372 DEBUG [RS:0;jenkins-hbase4:40141] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:59:39,372 DEBUG [RS:0;jenkins-hbase4:40141] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 05:59:39,373 INFO [RS:0;jenkins-hbase4:40141] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,373 INFO [RS:0;jenkins-hbase4:40141] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,373 INFO [RS:0;jenkins-hbase4:40141] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,384 INFO [RS:0;jenkins-hbase4:40141] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-11 05:59:39,384 INFO [RS:0;jenkins-hbase4:40141] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40141,1691733579120-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,395 INFO [RS:0;jenkins-hbase4:40141] regionserver.Replication(203): jenkins-hbase4.apache.org,40141,1691733579120 started 2023-08-11 05:59:39,395 INFO [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40141,1691733579120, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40141, sessionid=0x101f29c58340001 2023-08-11 05:59:39,395 DEBUG [RS:0;jenkins-hbase4:40141] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-11 05:59:39,395 DEBUG [RS:0;jenkins-hbase4:40141] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 05:59:39,395 DEBUG [RS:0;jenkins-hbase4:40141] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40141,1691733579120' 2023-08-11 05:59:39,395 DEBUG [RS:0;jenkins-hbase4:40141] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 05:59:39,396 DEBUG [RS:0;jenkins-hbase4:40141] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 05:59:39,396 DEBUG [RS:0;jenkins-hbase4:40141] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-11 05:59:39,396 DEBUG [RS:0;jenkins-hbase4:40141] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-11 05:59:39,396 DEBUG [RS:0;jenkins-hbase4:40141] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 05:59:39,396 DEBUG [RS:0;jenkins-hbase4:40141] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40141,1691733579120' 2023-08-11 05:59:39,396 DEBUG [RS:0;jenkins-hbase4:40141] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-11 05:59:39,396 DEBUG [RS:0;jenkins-hbase4:40141] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-11 05:59:39,397 DEBUG [RS:0;jenkins-hbase4:40141] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-11 05:59:39,397 INFO [RS:0;jenkins-hbase4:40141] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-11 05:59:39,397 INFO [RS:0;jenkins-hbase4:40141] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-11 05:59:39,472 DEBUG [jenkins-hbase4:36765] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-11 05:59:39,473 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40141,1691733579120, state=OPENING 2023-08-11 05:59:39,475 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-11 05:59:39,477 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:59:39,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40141,1691733579120}] 2023-08-11 05:59:39,477 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 05:59:39,499 INFO [RS:0;jenkins-hbase4:40141] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40141%2C1691733579120, suffix=, logDir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120, archiveDir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/oldWALs, maxLogs=32 2023-08-11 05:59:39,515 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34381,DS-c9721935-3327-4425-9403-cf02de7e1b8b,DISK] 2023-08-11 05:59:39,515 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33717,DS-0fa6580a-a0d6-4400-bacc-1283d3a90e58,DISK] 2023-08-11 05:59:39,517 INFO [RS:0;jenkins-hbase4:40141] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120/jenkins-hbase4.apache.org%2C40141%2C1691733579120.1691733579499 2023-08-11 05:59:39,517 DEBUG [RS:0;jenkins-hbase4:40141] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34381,DS-c9721935-3327-4425-9403-cf02de7e1b8b,DISK], DatanodeInfoWithStorage[127.0.0.1:33717,DS-0fa6580a-a0d6-4400-bacc-1283d3a90e58,DISK]] 2023-08-11 05:59:39,631 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 05:59:39,632 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-11 05:59:39,634 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-11 05:59:39,638 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-11 05:59:39,638 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 05:59:39,640 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40141%2C1691733579120.meta, suffix=.meta, logDir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120, archiveDir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/oldWALs, maxLogs=32 2023-08-11 05:59:39,654 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33717,DS-0fa6580a-a0d6-4400-bacc-1283d3a90e58,DISK] 2023-08-11 05:59:39,655 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34381,DS-c9721935-3327-4425-9403-cf02de7e1b8b,DISK] 2023-08-11 05:59:39,656 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120/jenkins-hbase4.apache.org%2C40141%2C1691733579120.meta.1691733579640.meta 2023-08-11 05:59:39,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33717,DS-0fa6580a-a0d6-4400-bacc-1283d3a90e58,DISK], DatanodeInfoWithStorage[127.0.0.1:34381,DS-c9721935-3327-4425-9403-cf02de7e1b8b,DISK]] 2023-08-11 05:59:39,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:59:39,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-11 05:59:39,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-11 05:59:39,657 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-11 05:59:39,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-11 05:59:39,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:59:39,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-11 05:59:39,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-11 05:59:39,659 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 05:59:39,660 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/info 2023-08-11 05:59:39,660 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/info 2023-08-11 05:59:39,661 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 05:59:39,661 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:59:39,662 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 05:59:39,662 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/rep_barrier 2023-08-11 05:59:39,663 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/rep_barrier 2023-08-11 05:59:39,663 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 05:59:39,664 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:59:39,664 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 05:59:39,665 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/table 2023-08-11 05:59:39,665 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/table 2023-08-11 05:59:39,665 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 05:59:39,666 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:59:39,667 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740 2023-08-11 05:59:39,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740 2023-08-11 05:59:39,670 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 05:59:39,671 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 05:59:39,672 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=826293, jitterRate=0.05068597197532654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 05:59:39,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 05:59:39,673 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1691733579631 2023-08-11 05:59:39,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-11 05:59:39,677 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-11 05:59:39,677 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40141,1691733579120, state=OPEN 2023-08-11 05:59:39,679 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-11 05:59:39,679 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 05:59:39,681 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-11 05:59:39,681 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40141,1691733579120 in 202 msec 2023-08-11 05:59:39,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-11 05:59:39,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-08-11 05:59:39,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 414 msec 2023-08-11 05:59:39,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1691733579685, completionTime=-1 2023-08-11 05:59:39,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-11 05:59:39,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-11 05:59:39,688 DEBUG [hconnection-0x623b236c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 05:59:39,689 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 05:59:39,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-11 05:59:39,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1691733639690 2023-08-11 05:59:39,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1691733699690 2023-08-11 05:59:39,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-08-11 05:59:39,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36765,1691733579078-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36765,1691733579078-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36765,1691733579078-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36765, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-11 05:59:39,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-11 05:59:39,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 05:59:39,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-11 05:59:39,697 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-11 05:59:39,698 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 05:59:39,699 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 05:59:39,700 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/.tmp/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977 2023-08-11 05:59:39,701 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/.tmp/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977 empty. 2023-08-11 05:59:39,701 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/.tmp/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977 2023-08-11 05:59:39,701 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-11 05:59:39,712 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-11 05:59:39,713 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 25247a3d65bbb458b00fea2742ff1977, NAME => 'hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/.tmp 2023-08-11 05:59:39,721 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:59:39,722 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 25247a3d65bbb458b00fea2742ff1977, disabling compactions & flushes 2023-08-11 05:59:39,722 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. 2023-08-11 05:59:39,722 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. 2023-08-11 05:59:39,722 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. after waiting 0 ms 2023-08-11 05:59:39,722 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. 2023-08-11 05:59:39,722 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. 2023-08-11 05:59:39,722 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 25247a3d65bbb458b00fea2742ff1977: 2023-08-11 05:59:39,724 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 05:59:39,725 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691733579725"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691733579725"}]},"ts":"1691733579725"} 2023-08-11 05:59:39,727 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 05:59:39,728 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 05:59:39,729 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733579728"}]},"ts":"1691733579728"} 2023-08-11 05:59:39,730 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-11 05:59:39,739 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=25247a3d65bbb458b00fea2742ff1977, ASSIGN}] 2023-08-11 05:59:39,741 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=25247a3d65bbb458b00fea2742ff1977, ASSIGN 2023-08-11 05:59:39,741 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=25247a3d65bbb458b00fea2742ff1977, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40141,1691733579120; forceNewPlan=false, retain=false 2023-08-11 05:59:39,892 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=25247a3d65bbb458b00fea2742ff1977, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 05:59:39,893 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691733579892"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691733579892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691733579892"}]},"ts":"1691733579892"} 2023-08-11 05:59:39,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 25247a3d65bbb458b00fea2742ff1977, server=jenkins-hbase4.apache.org,40141,1691733579120}] 2023-08-11 05:59:40,051 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. 2023-08-11 05:59:40,051 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 25247a3d65bbb458b00fea2742ff1977, NAME => 'hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977.', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:59:40,051 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 25247a3d65bbb458b00fea2742ff1977 2023-08-11 05:59:40,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:59:40,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 25247a3d65bbb458b00fea2742ff1977 2023-08-11 05:59:40,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 25247a3d65bbb458b00fea2742ff1977 2023-08-11 05:59:40,053 INFO [StoreOpener-25247a3d65bbb458b00fea2742ff1977-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 25247a3d65bbb458b00fea2742ff1977 2023-08-11 05:59:40,054 DEBUG [StoreOpener-25247a3d65bbb458b00fea2742ff1977-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977/info 2023-08-11 05:59:40,054 DEBUG [StoreOpener-25247a3d65bbb458b00fea2742ff1977-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977/info 2023-08-11 05:59:40,055 INFO [StoreOpener-25247a3d65bbb458b00fea2742ff1977-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25247a3d65bbb458b00fea2742ff1977 columnFamilyName info 2023-08-11 05:59:40,055 INFO [StoreOpener-25247a3d65bbb458b00fea2742ff1977-1] regionserver.HStore(310): Store=25247a3d65bbb458b00fea2742ff1977/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:59:40,056 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977 2023-08-11 05:59:40,057 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977 2023-08-11 05:59:40,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 25247a3d65bbb458b00fea2742ff1977 2023-08-11 05:59:40,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:59:40,062 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 25247a3d65bbb458b00fea2742ff1977; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=704745, jitterRate=-0.10387119650840759}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:59:40,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 25247a3d65bbb458b00fea2742ff1977: 2023-08-11 05:59:40,063 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977., pid=6, masterSystemTime=1691733580047 2023-08-11 05:59:40,065 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. 2023-08-11 05:59:40,065 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. 2023-08-11 05:59:40,066 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=25247a3d65bbb458b00fea2742ff1977, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 05:59:40,066 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691733580065"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691733580065"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691733580065"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691733580065"}]},"ts":"1691733580065"} 2023-08-11 05:59:40,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-11 05:59:40,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 25247a3d65bbb458b00fea2742ff1977, server=jenkins-hbase4.apache.org,40141,1691733579120 in 172 msec 2023-08-11 05:59:40,072 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-11 05:59:40,072 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=25247a3d65bbb458b00fea2742ff1977, ASSIGN in 331 msec 2023-08-11 05:59:40,073 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 05:59:40,073 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733580073"}]},"ts":"1691733580073"} 2023-08-11 05:59:40,074 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-11 05:59:40,076 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 05:59:40,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 380 msec 2023-08-11 05:59:40,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-11 05:59:40,099 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-11 05:59:40,099 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:59:40,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-11 05:59:40,112 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 05:59:40,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-08-11 05:59:40,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-11 05:59:40,135 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 05:59:40,138 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-08-11 05:59:40,151 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-11 05:59:40,153 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-11 05:59:40,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.014sec 2023-08-11 05:59:40,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-11 05:59:40,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-11 05:59:40,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-11 05:59:40,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36765,1691733579078-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-11 05:59:40,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36765,1691733579078-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-11 05:59:40,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-11 05:59:40,234 DEBUG [Listener at localhost/34697] zookeeper.ReadOnlyZKClient(139): Connect 0x14abad4e to 127.0.0.1:57410 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 05:59:40,241 DEBUG [Listener at localhost/34697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4732fc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 05:59:40,242 DEBUG [hconnection-0x11a694ce-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 05:59:40,245 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 05:59:40,246 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36765,1691733579078 2023-08-11 05:59:40,247 INFO [Listener at localhost/34697] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 05:59:40,250 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-11 05:59:40,250 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 05:59:40,251 INFO [Listener at localhost/34697] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-11 05:59:40,253 DEBUG [Listener at localhost/34697] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-08-11 05:59:40,255 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-08-11 05:59:40,257 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36765] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-08-11 05:59:40,257 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36765] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-08-11 05:59:40,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36765] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 05:59:40,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36765] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRolling 2023-08-11 05:59:40,261 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 05:59:40,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36765] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRolling" procId is: 9 2023-08-11 05:59:40,262 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 05:59:40,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36765] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-11 05:59:40,264 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/.tmp/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae 2023-08-11 05:59:40,265 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/.tmp/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae empty. 2023-08-11 05:59:40,265 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/.tmp/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae 2023-08-11 05:59:40,266 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRolling regions 2023-08-11 05:59:40,278 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/.tmp/data/default/TestLogRolling-testLogRolling/.tabledesc/.tableinfo.0000000001 2023-08-11 05:59:40,280 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => 34ed0bd9014f9dee3551a256122cbeae, NAME => 'TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/.tmp 2023-08-11 05:59:40,289 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:59:40,289 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1604): Closing 34ed0bd9014f9dee3551a256122cbeae, disabling compactions & flushes 2023-08-11 05:59:40,289 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 05:59:40,289 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 05:59:40,289 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. after waiting 0 ms 2023-08-11 05:59:40,289 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 05:59:40,289 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 05:59:40,289 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1558): Region close journal for 34ed0bd9014f9dee3551a256122cbeae: 2023-08-11 05:59:40,292 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 05:59:40,293 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691733580293"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691733580293"}]},"ts":"1691733580293"} 2023-08-11 05:59:40,295 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 05:59:40,295 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 05:59:40,296 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733580296"}]},"ts":"1691733580296"} 2023-08-11 05:59:40,297 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLING in hbase:meta 2023-08-11 05:59:40,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=34ed0bd9014f9dee3551a256122cbeae, ASSIGN}] 2023-08-11 05:59:40,302 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=34ed0bd9014f9dee3551a256122cbeae, ASSIGN 2023-08-11 05:59:40,303 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=34ed0bd9014f9dee3551a256122cbeae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40141,1691733579120; forceNewPlan=false, retain=false 2023-08-11 05:59:40,454 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=34ed0bd9014f9dee3551a256122cbeae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 05:59:40,454 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691733580454"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691733580454"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691733580454"}]},"ts":"1691733580454"} 2023-08-11 05:59:40,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 34ed0bd9014f9dee3551a256122cbeae, server=jenkins-hbase4.apache.org,40141,1691733579120}] 2023-08-11 05:59:40,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 05:59:40,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34ed0bd9014f9dee3551a256122cbeae, NAME => 'TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.', STARTKEY => '', ENDKEY => ''} 2023-08-11 05:59:40,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 05:59:40,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 05:59:40,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 05:59:40,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 05:59:40,615 INFO [StoreOpener-34ed0bd9014f9dee3551a256122cbeae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 05:59:40,616 DEBUG [StoreOpener-34ed0bd9014f9dee3551a256122cbeae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info 2023-08-11 05:59:40,616 DEBUG [StoreOpener-34ed0bd9014f9dee3551a256122cbeae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info 2023-08-11 05:59:40,617 INFO [StoreOpener-34ed0bd9014f9dee3551a256122cbeae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34ed0bd9014f9dee3551a256122cbeae columnFamilyName info 2023-08-11 05:59:40,617 INFO [StoreOpener-34ed0bd9014f9dee3551a256122cbeae-1] regionserver.HStore(310): Store=34ed0bd9014f9dee3551a256122cbeae/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 05:59:40,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae 2023-08-11 05:59:40,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae 2023-08-11 05:59:40,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 05:59:40,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 05:59:40,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 34ed0bd9014f9dee3551a256122cbeae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=765518, jitterRate=-0.026593878865242004}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 05:59:40,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 34ed0bd9014f9dee3551a256122cbeae: 2023-08-11 05:59:40,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae., pid=11, masterSystemTime=1691733580609 2023-08-11 05:59:40,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 05:59:40,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 05:59:40,629 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=34ed0bd9014f9dee3551a256122cbeae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 05:59:40,629 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691733580629"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691733580629"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691733580629"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691733580629"}]},"ts":"1691733580629"} 2023-08-11 05:59:40,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-08-11 05:59:40,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 34ed0bd9014f9dee3551a256122cbeae, server=jenkins-hbase4.apache.org,40141,1691733579120 in 175 msec 2023-08-11 05:59:40,635 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-08-11 05:59:40,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=34ed0bd9014f9dee3551a256122cbeae, ASSIGN in 333 msec 2023-08-11 05:59:40,637 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 05:59:40,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733580637"}]},"ts":"1691733580637"} 2023-08-11 05:59:40,638 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLED in hbase:meta 2023-08-11 05:59:40,641 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 05:59:40,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRolling in 384 msec 2023-08-11 05:59:43,302 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-11 05:59:45,367 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-11 05:59:45,368 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-11 05:59:45,368 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRolling' 2023-08-11 05:59:50,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36765] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-08-11 05:59:50,264 INFO [Listener at localhost/34697] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRolling, procId: 9 completed 2023-08-11 05:59:50,267 DEBUG [Listener at localhost/34697] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRolling 2023-08-11 05:59:50,267 DEBUG [Listener at localhost/34697] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 05:59:50,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 05:59:50,281 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 34ed0bd9014f9dee3551a256122cbeae 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 05:59:50,295 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=12 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/3e94fe80fce54e22a3a931eb78adde83 2023-08-11 05:59:50,304 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/3e94fe80fce54e22a3a931eb78adde83 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3e94fe80fce54e22a3a931eb78adde83 2023-08-11 05:59:50,310 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3e94fe80fce54e22a3a931eb78adde83, entries=8, sequenceid=12, filesize=13.0 K 2023-08-11 05:59:50,311 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=20.53 KB/21020 for 34ed0bd9014f9dee3551a256122cbeae in 30ms, sequenceid=12, compaction requested=false 2023-08-11 05:59:50,312 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 34ed0bd9014f9dee3551a256122cbeae: 2023-08-11 05:59:50,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 05:59:50,312 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 34ed0bd9014f9dee3551a256122cbeae 1/1 column families, dataSize=21.55 KB heapSize=23.38 KB 2023-08-11 05:59:50,327 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=21.55 KB at sequenceid=36 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/f174aa9edb6040179852aa39c078172b 2023-08-11 05:59:50,334 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/f174aa9edb6040179852aa39c078172b as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f174aa9edb6040179852aa39c078172b 2023-08-11 05:59:50,340 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f174aa9edb6040179852aa39c078172b, entries=21, sequenceid=36, filesize=26.3 K 2023-08-11 05:59:50,342 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~21.55 KB/22071, heapSize ~23.37 KB/23928, currentSize=3.08 KB/3153 for 34ed0bd9014f9dee3551a256122cbeae in 29ms, sequenceid=36, compaction requested=false 2023-08-11 05:59:50,342 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 34ed0bd9014f9dee3551a256122cbeae: 2023-08-11 05:59:50,342 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=39.3 K, sizeToCheck=16.0 K 2023-08-11 05:59:50,342 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-11 05:59:50,343 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f174aa9edb6040179852aa39c078172b because midkey is the same as first or last row 2023-08-11 05:59:52,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 05:59:52,322 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 34ed0bd9014f9dee3551a256122cbeae 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 05:59:52,342 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=47 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/256916d7ef874fdda826acef3cfbd024 2023-08-11 05:59:52,350 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/256916d7ef874fdda826acef3cfbd024 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/256916d7ef874fdda826acef3cfbd024 2023-08-11 05:59:52,351 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=34ed0bd9014f9dee3551a256122cbeae, server=jenkins-hbase4.apache.org,40141,1691733579120 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 05:59:52,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] ipc.CallRunner(144): callId: 67 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:42646 deadline: 1691733602351, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=34ed0bd9014f9dee3551a256122cbeae, server=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 05:59:52,356 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/256916d7ef874fdda826acef3cfbd024, entries=8, sequenceid=47, filesize=13.0 K 2023-08-11 05:59:52,357 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 34ed0bd9014f9dee3551a256122cbeae in 35ms, sequenceid=47, compaction requested=true 2023-08-11 05:59:52,357 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 34ed0bd9014f9dee3551a256122cbeae: 2023-08-11 05:59:52,357 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=52.3 K, sizeToCheck=16.0 K 2023-08-11 05:59:52,357 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-11 05:59:52,357 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f174aa9edb6040179852aa39c078172b because midkey is the same as first or last row 2023-08-11 05:59:52,359 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 05:59:52,359 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 05:59:52,360 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 53524 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 05:59:52,361 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1912): 34ed0bd9014f9dee3551a256122cbeae/info is initiating minor compaction (all files) 2023-08-11 05:59:52,361 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 34ed0bd9014f9dee3551a256122cbeae/info in TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 05:59:52,361 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3e94fe80fce54e22a3a931eb78adde83, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f174aa9edb6040179852aa39c078172b, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/256916d7ef874fdda826acef3cfbd024] into tmpdir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp, totalSize=52.3 K 2023-08-11 05:59:52,361 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 3e94fe80fce54e22a3a931eb78adde83, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1691733590270 2023-08-11 05:59:52,362 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting f174aa9edb6040179852aa39c078172b, keycount=21, bloomtype=ROW, size=26.3 K, encoding=NONE, compression=NONE, seqNum=36, earliestPutTs=1691733590282 2023-08-11 05:59:52,362 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 256916d7ef874fdda826acef3cfbd024, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1691733590313 2023-08-11 05:59:52,375 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] throttle.PressureAwareThroughputController(145): 34ed0bd9014f9dee3551a256122cbeae#info#compaction#18 average throughput is 18.54 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 05:59:52,395 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/3828d79d5a8e4c118c682b7bd0e52247 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3828d79d5a8e4c118c682b7bd0e52247 2023-08-11 05:59:52,402 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 34ed0bd9014f9dee3551a256122cbeae/info of 34ed0bd9014f9dee3551a256122cbeae into 3828d79d5a8e4c118c682b7bd0e52247(size=42.9 K), total size for store is 42.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 05:59:52,402 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 34ed0bd9014f9dee3551a256122cbeae: 2023-08-11 05:59:52,402 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae., storeName=34ed0bd9014f9dee3551a256122cbeae/info, priority=13, startTime=1691733592358; duration=0sec 2023-08-11 05:59:52,403 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=42.9 K, sizeToCheck=16.0 K 2023-08-11 05:59:52,403 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-11 05:59:52,403 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.StoreUtils(129): cannot split hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3828d79d5a8e4c118c682b7bd0e52247 because midkey is the same as first or last row 2023-08-11 05:59:52,404 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:00:02,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 06:00:02,386 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 34ed0bd9014f9dee3551a256122cbeae 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-11 06:00:02,401 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=73 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/b9943ca996ee4578b3d5a7d45ff21fa8 2023-08-11 06:00:02,408 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/b9943ca996ee4578b3d5a7d45ff21fa8 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/b9943ca996ee4578b3d5a7d45ff21fa8 2023-08-11 06:00:02,414 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/b9943ca996ee4578b3d5a7d45ff21fa8, entries=22, sequenceid=73, filesize=27.4 K 2023-08-11 06:00:02,415 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=5.13 KB/5255 for 34ed0bd9014f9dee3551a256122cbeae in 29ms, sequenceid=73, compaction requested=false 2023-08-11 06:00:02,415 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 34ed0bd9014f9dee3551a256122cbeae: 2023-08-11 06:00:02,415 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=70.3 K, sizeToCheck=16.0 K 2023-08-11 06:00:02,415 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-11 06:00:02,415 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3828d79d5a8e4c118c682b7bd0e52247 because midkey is the same as first or last row 2023-08-11 06:00:04,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 06:00:04,399 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 34ed0bd9014f9dee3551a256122cbeae 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 06:00:04,434 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=84 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/1548aab3e46242de9d067d50bc3f53f5 2023-08-11 06:00:04,438 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=34ed0bd9014f9dee3551a256122cbeae, server=jenkins-hbase4.apache.org,40141,1691733579120 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 06:00:04,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] ipc.CallRunner(144): callId: 99 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:42646 deadline: 1691733614438, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=34ed0bd9014f9dee3551a256122cbeae, server=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:00:04,443 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/1548aab3e46242de9d067d50bc3f53f5 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/1548aab3e46242de9d067d50bc3f53f5 2023-08-11 06:00:04,457 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/1548aab3e46242de9d067d50bc3f53f5, entries=8, sequenceid=84, filesize=13.0 K 2023-08-11 06:00:04,458 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 34ed0bd9014f9dee3551a256122cbeae in 59ms, sequenceid=84, compaction requested=true 2023-08-11 06:00:04,458 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 34ed0bd9014f9dee3551a256122cbeae: 2023-08-11 06:00:04,459 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=83.2 K, sizeToCheck=16.0 K 2023-08-11 06:00:04,459 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-11 06:00:04,459 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3828d79d5a8e4c118c682b7bd0e52247 because midkey is the same as first or last row 2023-08-11 06:00:04,459 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:00:04,459 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 06:00:04,461 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 85243 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 06:00:04,461 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1912): 34ed0bd9014f9dee3551a256122cbeae/info is initiating minor compaction (all files) 2023-08-11 06:00:04,461 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 34ed0bd9014f9dee3551a256122cbeae/info in TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 06:00:04,461 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3828d79d5a8e4c118c682b7bd0e52247, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/b9943ca996ee4578b3d5a7d45ff21fa8, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/1548aab3e46242de9d067d50bc3f53f5] into tmpdir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp, totalSize=83.2 K 2023-08-11 06:00:04,462 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 3828d79d5a8e4c118c682b7bd0e52247, keycount=37, bloomtype=ROW, size=42.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1691733590270 2023-08-11 06:00:04,462 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting b9943ca996ee4578b3d5a7d45ff21fa8, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=73, earliestPutTs=1691733592323 2023-08-11 06:00:04,463 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 1548aab3e46242de9d067d50bc3f53f5, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=84, earliestPutTs=1691733602387 2023-08-11 06:00:04,482 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] throttle.PressureAwareThroughputController(145): 34ed0bd9014f9dee3551a256122cbeae#info#compaction#21 average throughput is 13.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 06:00:04,504 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/d04b124f74c946da9277559dc9bbd102 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/d04b124f74c946da9277559dc9bbd102 2023-08-11 06:00:04,513 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 34ed0bd9014f9dee3551a256122cbeae/info of 34ed0bd9014f9dee3551a256122cbeae into d04b124f74c946da9277559dc9bbd102(size=74.0 K), total size for store is 74.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 06:00:04,513 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 34ed0bd9014f9dee3551a256122cbeae: 2023-08-11 06:00:04,513 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae., storeName=34ed0bd9014f9dee3551a256122cbeae/info, priority=13, startTime=1691733604459; duration=0sec 2023-08-11 06:00:04,513 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=74.0 K, sizeToCheck=16.0 K 2023-08-11 06:00:04,513 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-08-11 06:00:04,514 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit(227): Splitting TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae., compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:00:04,514 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:00:04,515 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36765] assignment.AssignmentManager(1140): Split request from jenkins-hbase4.apache.org,40141,1691733579120, parent={ENCODED => 34ed0bd9014f9dee3551a256122cbeae, NAME => 'TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.', STARTKEY => '', ENDKEY => ''} splitKey=row0064 2023-08-11 06:00:04,524 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36765] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:00:04,533 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36765] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=34ed0bd9014f9dee3551a256122cbeae, daughterA=bfdaf387a2b50b5b09026b7604e48753, daughterB=53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:04,535 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=34ed0bd9014f9dee3551a256122cbeae, daughterA=bfdaf387a2b50b5b09026b7604e48753, daughterB=53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:04,535 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=34ed0bd9014f9dee3551a256122cbeae, daughterA=bfdaf387a2b50b5b09026b7604e48753, daughterB=53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:04,535 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=34ed0bd9014f9dee3551a256122cbeae, daughterA=bfdaf387a2b50b5b09026b7604e48753, daughterB=53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:04,546 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=34ed0bd9014f9dee3551a256122cbeae, UNASSIGN}] 2023-08-11 06:00:04,548 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=34ed0bd9014f9dee3551a256122cbeae, UNASSIGN 2023-08-11 06:00:04,549 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=34ed0bd9014f9dee3551a256122cbeae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:00:04,550 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691733604549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691733604549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691733604549"}]},"ts":"1691733604549"} 2023-08-11 06:00:04,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; CloseRegionProcedure 34ed0bd9014f9dee3551a256122cbeae, server=jenkins-hbase4.apache.org,40141,1691733579120}] 2023-08-11 06:00:04,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 06:00:04,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 34ed0bd9014f9dee3551a256122cbeae, disabling compactions & flushes 2023-08-11 06:00:04,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 06:00:04,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 06:00:04,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. after waiting 0 ms 2023-08-11 06:00:04,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 06:00:04,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 34ed0bd9014f9dee3551a256122cbeae 1/1 column families, dataSize=21.55 KB heapSize=23.38 KB 2023-08-11 06:00:04,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=21.55 KB at sequenceid=109 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/f915960e9bff441e873dfc3e205bfe53 2023-08-11 06:00:04,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.tmp/info/f915960e9bff441e873dfc3e205bfe53 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f915960e9bff441e873dfc3e205bfe53 2023-08-11 06:00:04,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f915960e9bff441e873dfc3e205bfe53, entries=21, sequenceid=109, filesize=26.3 K 2023-08-11 06:00:04,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~21.55 KB/22071, heapSize ~23.37 KB/23928, currentSize=0 B/0 for 34ed0bd9014f9dee3551a256122cbeae in 41ms, sequenceid=109, compaction requested=false 2023-08-11 06:00:04,777 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3e94fe80fce54e22a3a931eb78adde83, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f174aa9edb6040179852aa39c078172b, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3828d79d5a8e4c118c682b7bd0e52247, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/256916d7ef874fdda826acef3cfbd024, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/b9943ca996ee4578b3d5a7d45ff21fa8, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/1548aab3e46242de9d067d50bc3f53f5] to archive 2023-08-11 06:00:04,781 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-11 06:00:04,785 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3e94fe80fce54e22a3a931eb78adde83 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3e94fe80fce54e22a3a931eb78adde83 2023-08-11 06:00:04,787 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f174aa9edb6040179852aa39c078172b to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f174aa9edb6040179852aa39c078172b 2023-08-11 06:00:04,789 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3828d79d5a8e4c118c682b7bd0e52247 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/3828d79d5a8e4c118c682b7bd0e52247 2023-08-11 06:00:04,791 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/256916d7ef874fdda826acef3cfbd024 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/256916d7ef874fdda826acef3cfbd024 2023-08-11 06:00:04,793 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/b9943ca996ee4578b3d5a7d45ff21fa8 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/b9943ca996ee4578b3d5a7d45ff21fa8 2023-08-11 06:00:04,795 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/1548aab3e46242de9d067d50bc3f53f5 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/1548aab3e46242de9d067d50bc3f53f5 2023-08-11 06:00:04,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/recovered.edits/112.seqid, newMaxSeqId=112, maxSeqId=1 2023-08-11 06:00:04,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. 2023-08-11 06:00:04,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 34ed0bd9014f9dee3551a256122cbeae: 2023-08-11 06:00:04,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 06:00:04,819 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=34ed0bd9014f9dee3551a256122cbeae, regionState=CLOSED 2023-08-11 06:00:04,820 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691733604819"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691733604819"}]},"ts":"1691733604819"} 2023-08-11 06:00:04,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-08-11 06:00:04,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; CloseRegionProcedure 34ed0bd9014f9dee3551a256122cbeae, server=jenkins-hbase4.apache.org,40141,1691733579120 in 270 msec 2023-08-11 06:00:04,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-08-11 06:00:04,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=34ed0bd9014f9dee3551a256122cbeae, UNASSIGN in 279 msec 2023-08-11 06:00:04,847 INFO [PEWorker-2] assignment.SplitTableRegionProcedure(694): pid=12 splitting 2 storefiles, region=34ed0bd9014f9dee3551a256122cbeae, threads=2 2023-08-11 06:00:04,848 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/d04b124f74c946da9277559dc9bbd102 for region: 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 06:00:04,856 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f915960e9bff441e873dfc3e205bfe53 for region: 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 06:00:04,871 DEBUG [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f915960e9bff441e873dfc3e205bfe53, top=true 2023-08-11 06:00:04,886 INFO [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/.splits/53f5d27324a1528d7e414cd4f606e7a6/info/TestLogRolling-testLogRolling=34ed0bd9014f9dee3551a256122cbeae-f915960e9bff441e873dfc3e205bfe53 for child: 53f5d27324a1528d7e414cd4f606e7a6, parent: 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 06:00:04,887 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/f915960e9bff441e873dfc3e205bfe53 for region: 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 06:00:04,925 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/d04b124f74c946da9277559dc9bbd102 for region: 34ed0bd9014f9dee3551a256122cbeae 2023-08-11 06:00:04,926 DEBUG [PEWorker-2] assignment.SplitTableRegionProcedure(755): pid=12 split storefiles for region 34ed0bd9014f9dee3551a256122cbeae Daughter A: 1 storefiles, Daughter B: 2 storefiles. 2023-08-11 06:00:05,370 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753/recovered.edits/112.seqid, newMaxSeqId=112, maxSeqId=-1 2023-08-11 06:00:05,373 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/recovered.edits/112.seqid, newMaxSeqId=112, maxSeqId=-1 2023-08-11 06:00:05,376 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1691733605376"},{"qualifier":"splitA","vlen":70,"tag":[],"timestamp":"1691733605376"},{"qualifier":"splitB","vlen":70,"tag":[],"timestamp":"1691733605376"}]},"ts":"1691733605376"} 2023-08-11 06:00:05,376 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691733605376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691733605376"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691733605376"}]},"ts":"1691733605376"} 2023-08-11 06:00:05,376 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691733605376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691733605376"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691733605376"}]},"ts":"1691733605376"} 2023-08-11 06:00:05,429 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40141] regionserver.HRegion(9158): Flush requested on 1588230740 2023-08-11 06:00:05,429 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy(69): Since none of the CFs were above the size, flushing all. 2023-08-11 06:00:05,429 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=4.82 KB heapSize=8.36 KB 2023-08-11 06:00:05,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=bfdaf387a2b50b5b09026b7604e48753, ASSIGN}, {pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=53f5d27324a1528d7e414cd4f606e7a6, ASSIGN}] 2023-08-11 06:00:05,443 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=bfdaf387a2b50b5b09026b7604e48753, ASSIGN 2023-08-11 06:00:05,443 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=53f5d27324a1528d7e414cd4f606e7a6, ASSIGN 2023-08-11 06:00:05,444 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=bfdaf387a2b50b5b09026b7604e48753, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,40141,1691733579120; forceNewPlan=false, retain=false 2023-08-11 06:00:05,444 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=53f5d27324a1528d7e414cd4f606e7a6, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,40141,1691733579120; forceNewPlan=false, retain=false 2023-08-11 06:00:05,449 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.61 KB at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/.tmp/info/86d96e7e8a784f36886f09255e23f126 2023-08-11 06:00:05,596 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=bfdaf387a2b50b5b09026b7604e48753, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:00:05,596 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691733605596"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691733605596"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691733605596"}]},"ts":"1691733605596"} 2023-08-11 06:00:05,597 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=53f5d27324a1528d7e414cd4f606e7a6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:00:05,597 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691733605597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691733605597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691733605597"}]},"ts":"1691733605597"} 2023-08-11 06:00:05,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure bfdaf387a2b50b5b09026b7604e48753, server=jenkins-hbase4.apache.org,40141,1691733579120}] 2023-08-11 06:00:05,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=16, state=RUNNABLE; OpenRegionProcedure 53f5d27324a1528d7e414cd4f606e7a6, server=jenkins-hbase4.apache.org,40141,1691733579120}] 2023-08-11 06:00:05,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753. 2023-08-11 06:00:05,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bfdaf387a2b50b5b09026b7604e48753, NAME => 'TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753.', STARTKEY => '', ENDKEY => 'row0064'} 2023-08-11 06:00:05,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling bfdaf387a2b50b5b09026b7604e48753 2023-08-11 06:00:05,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 06:00:05,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bfdaf387a2b50b5b09026b7604e48753 2023-08-11 06:00:05,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bfdaf387a2b50b5b09026b7604e48753 2023-08-11 06:00:05,763 INFO [StoreOpener-bfdaf387a2b50b5b09026b7604e48753-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region bfdaf387a2b50b5b09026b7604e48753 2023-08-11 06:00:05,764 DEBUG [StoreOpener-bfdaf387a2b50b5b09026b7604e48753-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753/info 2023-08-11 06:00:05,765 DEBUG [StoreOpener-bfdaf387a2b50b5b09026b7604e48753-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753/info 2023-08-11 06:00:05,765 INFO [StoreOpener-bfdaf387a2b50b5b09026b7604e48753-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfdaf387a2b50b5b09026b7604e48753 columnFamilyName info 2023-08-11 06:00:05,781 DEBUG [StoreOpener-bfdaf387a2b50b5b09026b7604e48753-1] regionserver.HStore(539): loaded hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753/info/d04b124f74c946da9277559dc9bbd102.34ed0bd9014f9dee3551a256122cbeae->hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/d04b124f74c946da9277559dc9bbd102-bottom 2023-08-11 06:00:05,782 INFO [StoreOpener-bfdaf387a2b50b5b09026b7604e48753-1] regionserver.HStore(310): Store=bfdaf387a2b50b5b09026b7604e48753/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 06:00:05,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753 2023-08-11 06:00:05,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753 2023-08-11 06:00:05,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bfdaf387a2b50b5b09026b7604e48753 2023-08-11 06:00:05,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bfdaf387a2b50b5b09026b7604e48753; next sequenceid=113; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=768607, jitterRate=-0.02266576886177063}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 06:00:05,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bfdaf387a2b50b5b09026b7604e48753: 2023-08-11 06:00:05,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753., pid=17, masterSystemTime=1691733605756 2023-08-11 06:00:05,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:00:05,793 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-08-11 06:00:05,793 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753. 2023-08-11 06:00:05,793 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1912): bfdaf387a2b50b5b09026b7604e48753/info is initiating minor compaction (all files) 2023-08-11 06:00:05,794 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bfdaf387a2b50b5b09026b7604e48753/info in TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753. 2023-08-11 06:00:05,794 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753/info/d04b124f74c946da9277559dc9bbd102.34ed0bd9014f9dee3551a256122cbeae->hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/d04b124f74c946da9277559dc9bbd102-bottom] into tmpdir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753/.tmp, totalSize=74.0 K 2023-08-11 06:00:05,794 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting d04b124f74c946da9277559dc9bbd102.34ed0bd9014f9dee3551a256122cbeae, keycount=33, bloomtype=ROW, size=74.0 K, encoding=NONE, compression=NONE, seqNum=84, earliestPutTs=1691733590270 2023-08-11 06:00:05,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753. 2023-08-11 06:00:05,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753. 2023-08-11 06:00:05,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:00:05,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 53f5d27324a1528d7e414cd4f606e7a6, NAME => 'TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.', STARTKEY => 'row0064', ENDKEY => ''} 2023-08-11 06:00:05,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:05,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 06:00:05,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:05,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:05,806 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] throttle.PressureAwareThroughputController(145): bfdaf387a2b50b5b09026b7604e48753#info#compaction#25 average throughput is 21.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 06:00:05,811 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=bfdaf387a2b50b5b09026b7604e48753, regionState=OPEN, openSeqNum=113, regionLocation=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:00:05,812 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691733605811"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691733605811"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691733605811"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691733605811"}]},"ts":"1691733605811"} 2023-08-11 06:00:05,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-08-11 06:00:05,835 INFO [StoreOpener-53f5d27324a1528d7e414cd4f606e7a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:05,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure bfdaf387a2b50b5b09026b7604e48753, server=jenkins-hbase4.apache.org,40141,1691733579120 in 211 msec 2023-08-11 06:00:05,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=bfdaf387a2b50b5b09026b7604e48753, ASSIGN in 396 msec 2023-08-11 06:00:05,846 DEBUG [StoreOpener-53f5d27324a1528d7e414cd4f606e7a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info 2023-08-11 06:00:05,847 DEBUG [StoreOpener-53f5d27324a1528d7e414cd4f606e7a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info 2023-08-11 06:00:05,848 INFO [StoreOpener-53f5d27324a1528d7e414cd4f606e7a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53f5d27324a1528d7e414cd4f606e7a6 columnFamilyName info 2023-08-11 06:00:05,930 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=216 B at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/.tmp/table/1b0a095251f547f897f4195808d98ed0 2023-08-11 06:00:05,943 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753/.tmp/info/750563eeaf4542d5911f061009aacc90 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753/info/750563eeaf4542d5911f061009aacc90 2023-08-11 06:00:05,949 DEBUG [StoreOpener-53f5d27324a1528d7e414cd4f606e7a6-1] regionserver.HStore(539): loaded hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/TestLogRolling-testLogRolling=34ed0bd9014f9dee3551a256122cbeae-f915960e9bff441e873dfc3e205bfe53 2023-08-11 06:00:05,955 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/.tmp/info/86d96e7e8a784f36886f09255e23f126 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/info/86d96e7e8a784f36886f09255e23f126 2023-08-11 06:00:05,958 DEBUG [StoreOpener-53f5d27324a1528d7e414cd4f606e7a6-1] regionserver.HStore(539): loaded hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/d04b124f74c946da9277559dc9bbd102.34ed0bd9014f9dee3551a256122cbeae->hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/d04b124f74c946da9277559dc9bbd102-top 2023-08-11 06:00:05,958 INFO [StoreOpener-53f5d27324a1528d7e414cd4f606e7a6-1] regionserver.HStore(310): Store=53f5d27324a1528d7e414cd4f606e7a6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 06:00:05,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:05,963 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in bfdaf387a2b50b5b09026b7604e48753/info of bfdaf387a2b50b5b09026b7604e48753 into 750563eeaf4542d5911f061009aacc90(size=69.7 K), total size for store is 69.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 06:00:05,963 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bfdaf387a2b50b5b09026b7604e48753: 2023-08-11 06:00:05,964 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753., storeName=bfdaf387a2b50b5b09026b7604e48753/info, priority=15, startTime=1691733605792; duration=0sec 2023-08-11 06:00:05,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:05,965 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:00:05,966 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/info/86d96e7e8a784f36886f09255e23f126, entries=29, sequenceid=17, filesize=8.6 K 2023-08-11 06:00:05,968 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/.tmp/table/1b0a095251f547f897f4195808d98ed0 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/table/1b0a095251f547f897f4195808d98ed0 2023-08-11 06:00:05,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:05,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 53f5d27324a1528d7e414cd4f606e7a6; next sequenceid=113; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=830504, jitterRate=0.056040599942207336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 06:00:05,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:00:05,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6., pid=18, masterSystemTime=1691733605756 2023-08-11 06:00:05,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:00:05,974 DEBUG [RS:0;jenkins-hbase4:40141-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 16 blocking 2023-08-11 06:00:05,976 INFO [RS:0;jenkins-hbase4:40141-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:00:05,976 DEBUG [RS:0;jenkins-hbase4:40141-longCompactions-0] regionserver.HStore(1912): 53f5d27324a1528d7e414cd4f606e7a6/info is initiating minor compaction (all files) 2023-08-11 06:00:05,976 INFO [RS:0;jenkins-hbase4:40141-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 53f5d27324a1528d7e414cd4f606e7a6/info in TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:00:05,976 INFO [RS:0;jenkins-hbase4:40141-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/d04b124f74c946da9277559dc9bbd102.34ed0bd9014f9dee3551a256122cbeae->hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/d04b124f74c946da9277559dc9bbd102-top, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/TestLogRolling-testLogRolling=34ed0bd9014f9dee3551a256122cbeae-f915960e9bff441e873dfc3e205bfe53] into tmpdir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp, totalSize=100.3 K 2023-08-11 06:00:05,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:00:05,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:00:05,977 DEBUG [RS:0;jenkins-hbase4:40141-longCompactions-0] compactions.Compactor(207): Compacting d04b124f74c946da9277559dc9bbd102.34ed0bd9014f9dee3551a256122cbeae, keycount=33, bloomtype=ROW, size=74.0 K, encoding=NONE, compression=NONE, seqNum=85, earliestPutTs=1691733590270 2023-08-11 06:00:05,978 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=53f5d27324a1528d7e414cd4f606e7a6, regionState=OPEN, openSeqNum=113, regionLocation=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:00:05,978 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1691733605978"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691733605978"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691733605978"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691733605978"}]},"ts":"1691733605978"} 2023-08-11 06:00:05,978 DEBUG [RS:0;jenkins-hbase4:40141-longCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=34ed0bd9014f9dee3551a256122cbeae-f915960e9bff441e873dfc3e205bfe53, keycount=21, bloomtype=ROW, size=26.3 K, encoding=NONE, compression=NONE, seqNum=109, earliestPutTs=1691733604399 2023-08-11 06:00:05,983 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=16 2023-08-11 06:00:05,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=16, state=SUCCESS; OpenRegionProcedure 53f5d27324a1528d7e414cd4f606e7a6, server=jenkins-hbase4.apache.org,40141,1691733579120 in 374 msec 2023-08-11 06:00:05,985 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/table/1b0a095251f547f897f4195808d98ed0, entries=4, sequenceid=17, filesize=4.8 K 2023-08-11 06:00:05,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=12 2023-08-11 06:00:05,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=53f5d27324a1528d7e414cd4f606e7a6, ASSIGN in 544 msec 2023-08-11 06:00:05,989 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~4.82 KB/4934, heapSize ~8.08 KB/8272, currentSize=2.26 KB/2312 for 1588230740 in 560ms, sequenceid=17, compaction requested=false 2023-08-11 06:00:05,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=34ed0bd9014f9dee3551a256122cbeae, daughterA=bfdaf387a2b50b5b09026b7604e48753, daughterB=53f5d27324a1528d7e414cd4f606e7a6 in 1.4630 sec 2023-08-11 06:00:06,000 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-08-11 06:00:06,002 INFO [RS:0;jenkins-hbase4:40141-longCompactions-0] throttle.PressureAwareThroughputController(145): 53f5d27324a1528d7e414cd4f606e7a6#info#compaction#26 average throughput is 25.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 06:00:06,063 DEBUG [RS:0;jenkins-hbase4:40141-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/997a15100f6e491b8ae8b9742c160272 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/997a15100f6e491b8ae8b9742c160272 2023-08-11 06:00:06,079 INFO [RS:0;jenkins-hbase4:40141-longCompactions-0] regionserver.HStore(1652): Completed compaction of 2 (all) file(s) in 53f5d27324a1528d7e414cd4f606e7a6/info of 53f5d27324a1528d7e414cd4f606e7a6 into 997a15100f6e491b8ae8b9742c160272(size=30.6 K), total size for store is 30.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 06:00:06,080 DEBUG [RS:0;jenkins-hbase4:40141-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:00:06,080 INFO [RS:0;jenkins-hbase4:40141-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6., storeName=53f5d27324a1528d7e414cd4f606e7a6/info, priority=14, startTime=1691733605973; duration=0sec 2023-08-11 06:00:06,080 DEBUG [RS:0;jenkins-hbase4:40141-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:00:10,363 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-08-11 06:00:14,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.14.131:42646 deadline: 1691733624506, exception=org.apache.hadoop.hbase.NotServingRegionException: TestLogRolling-testLogRolling,,1691733580257.34ed0bd9014f9dee3551a256122cbeae. is not online on jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:00:34,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:34,613 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 06:00:34,628 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=124 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/a5d1e49c7cbe4df48d00a1d7bfe27411 2023-08-11 06:00:34,633 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/a5d1e49c7cbe4df48d00a1d7bfe27411 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/a5d1e49c7cbe4df48d00a1d7bfe27411 2023-08-11 06:00:34,638 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/a5d1e49c7cbe4df48d00a1d7bfe27411, entries=8, sequenceid=124, filesize=13.0 K 2023-08-11 06:00:34,640 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=0 B/0 for 53f5d27324a1528d7e414cd4f606e7a6 in 27ms, sequenceid=124, compaction requested=false 2023-08-11 06:00:34,640 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:00:36,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:36,623 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 06:00:36,653 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=53f5d27324a1528d7e414cd4f606e7a6, server=jenkins-hbase4.apache.org,40141,1691733579120 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 06:00:36,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:42646 deadline: 1691733646653, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=53f5d27324a1528d7e414cd4f606e7a6, server=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:00:36,654 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=135 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/d0348e675428400ba4720d04460510a9 2023-08-11 06:00:36,662 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/d0348e675428400ba4720d04460510a9 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/d0348e675428400ba4720d04460510a9 2023-08-11 06:00:36,668 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/d0348e675428400ba4720d04460510a9, entries=8, sequenceid=135, filesize=13.0 K 2023-08-11 06:00:36,669 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 53f5d27324a1528d7e414cd4f606e7a6 in 46ms, sequenceid=135, compaction requested=true 2023-08-11 06:00:36,669 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:00:36,669 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:00:36,669 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 06:00:36,671 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 57905 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 06:00:36,671 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1912): 53f5d27324a1528d7e414cd4f606e7a6/info is initiating minor compaction (all files) 2023-08-11 06:00:36,671 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 53f5d27324a1528d7e414cd4f606e7a6/info in TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:00:36,671 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/997a15100f6e491b8ae8b9742c160272, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/a5d1e49c7cbe4df48d00a1d7bfe27411, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/d0348e675428400ba4720d04460510a9] into tmpdir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp, totalSize=56.5 K 2023-08-11 06:00:36,671 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 997a15100f6e491b8ae8b9742c160272, keycount=25, bloomtype=ROW, size=30.6 K, encoding=NONE, compression=NONE, seqNum=109, earliestPutTs=1691733602393 2023-08-11 06:00:36,672 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting a5d1e49c7cbe4df48d00a1d7bfe27411, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=124, earliestPutTs=1691733634604 2023-08-11 06:00:36,672 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting d0348e675428400ba4720d04460510a9, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=135, earliestPutTs=1691733636614 2023-08-11 06:00:36,688 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] throttle.PressureAwareThroughputController(145): 53f5d27324a1528d7e414cd4f606e7a6#info#compaction#29 average throughput is 20.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 06:00:36,707 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/b2ee59f63a6d44bcb698a648153aca89 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/b2ee59f63a6d44bcb698a648153aca89 2023-08-11 06:00:36,713 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 53f5d27324a1528d7e414cd4f606e7a6/info of 53f5d27324a1528d7e414cd4f606e7a6 into b2ee59f63a6d44bcb698a648153aca89(size=47.2 K), total size for store is 47.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 06:00:36,713 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:00:36,713 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6., storeName=53f5d27324a1528d7e414cd4f606e7a6/info, priority=13, startTime=1691733636669; duration=0sec 2023-08-11 06:00:36,713 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:00:46,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:46,735 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-11 06:00:46,760 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=161 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/c06d6619846c49fd9c45527685064d2f 2023-08-11 06:00:46,770 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/c06d6619846c49fd9c45527685064d2f as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/c06d6619846c49fd9c45527685064d2f 2023-08-11 06:00:46,786 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/c06d6619846c49fd9c45527685064d2f, entries=22, sequenceid=161, filesize=27.4 K 2023-08-11 06:00:46,795 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for 53f5d27324a1528d7e414cd4f606e7a6 in 59ms, sequenceid=161, compaction requested=false 2023-08-11 06:00:46,795 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:00:48,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:48,749 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 06:00:48,778 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=172 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/9b5ecce4504447bf8549349daf2d7244 2023-08-11 06:00:48,781 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=53f5d27324a1528d7e414cd4f606e7a6, server=jenkins-hbase4.apache.org,40141,1691733579120 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 06:00:48,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] ipc.CallRunner(144): callId: 174 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:42646 deadline: 1691733658781, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=53f5d27324a1528d7e414cd4f606e7a6, server=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:00:48,788 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/9b5ecce4504447bf8549349daf2d7244 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/9b5ecce4504447bf8549349daf2d7244 2023-08-11 06:00:48,794 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/9b5ecce4504447bf8549349daf2d7244, entries=8, sequenceid=172, filesize=13.0 K 2023-08-11 06:00:48,795 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 53f5d27324a1528d7e414cd4f606e7a6 in 46ms, sequenceid=172, compaction requested=true 2023-08-11 06:00:48,795 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:00:48,795 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:00:48,795 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 06:00:48,797 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 89653 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 06:00:48,797 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1912): 53f5d27324a1528d7e414cd4f606e7a6/info is initiating minor compaction (all files) 2023-08-11 06:00:48,797 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 53f5d27324a1528d7e414cd4f606e7a6/info in TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:00:48,797 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/b2ee59f63a6d44bcb698a648153aca89, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/c06d6619846c49fd9c45527685064d2f, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/9b5ecce4504447bf8549349daf2d7244] into tmpdir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp, totalSize=87.6 K 2023-08-11 06:00:48,797 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting b2ee59f63a6d44bcb698a648153aca89, keycount=41, bloomtype=ROW, size=47.2 K, encoding=NONE, compression=NONE, seqNum=135, earliestPutTs=1691733602393 2023-08-11 06:00:48,798 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting c06d6619846c49fd9c45527685064d2f, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=161, earliestPutTs=1691733636624 2023-08-11 06:00:48,798 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 9b5ecce4504447bf8549349daf2d7244, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=172, earliestPutTs=1691733646736 2023-08-11 06:00:48,810 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] throttle.PressureAwareThroughputController(145): 53f5d27324a1528d7e414cd4f606e7a6#info#compaction#32 average throughput is 35.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 06:00:48,827 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/444bf67b0bc84b5a9e8f59b4e41857c4 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/444bf67b0bc84b5a9e8f59b4e41857c4 2023-08-11 06:00:48,833 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 53f5d27324a1528d7e414cd4f606e7a6/info of 53f5d27324a1528d7e414cd4f606e7a6 into 444bf67b0bc84b5a9e8f59b4e41857c4(size=78.3 K), total size for store is 78.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 06:00:48,834 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:00:48,834 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6., storeName=53f5d27324a1528d7e414cd4f606e7a6/info, priority=13, startTime=1691733648795; duration=0sec 2023-08-11 06:00:48,834 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:00:58,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:00:58,790 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-11 06:00:58,801 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=198 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/85227b1f441442cfbffa883b8145e0dc 2023-08-11 06:00:58,808 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/85227b1f441442cfbffa883b8145e0dc as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/85227b1f441442cfbffa883b8145e0dc 2023-08-11 06:00:58,813 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/85227b1f441442cfbffa883b8145e0dc, entries=22, sequenceid=198, filesize=27.4 K 2023-08-11 06:00:58,814 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=4.11 KB/4204 for 53f5d27324a1528d7e414cd4f606e7a6 in 24ms, sequenceid=198, compaction requested=false 2023-08-11 06:00:58,814 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:00,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:01:00,801 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 06:01:00,813 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=209 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/6051236aadaf4707b085cddf6124a5a7 2023-08-11 06:01:00,820 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/6051236aadaf4707b085cddf6124a5a7 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6051236aadaf4707b085cddf6124a5a7 2023-08-11 06:01:00,826 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=53f5d27324a1528d7e414cd4f606e7a6, server=jenkins-hbase4.apache.org,40141,1691733579120 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 06:01:00,826 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6051236aadaf4707b085cddf6124a5a7, entries=8, sequenceid=209, filesize=13.0 K 2023-08-11 06:01:00,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:42646 deadline: 1691733670826, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=53f5d27324a1528d7e414cd4f606e7a6, server=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:01:00,827 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 53f5d27324a1528d7e414cd4f606e7a6 in 26ms, sequenceid=209, compaction requested=true 2023-08-11 06:01:00,827 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:00,828 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:01:00,828 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 06:01:00,829 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 121486 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 06:01:00,829 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1912): 53f5d27324a1528d7e414cd4f606e7a6/info is initiating minor compaction (all files) 2023-08-11 06:01:00,829 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 53f5d27324a1528d7e414cd4f606e7a6/info in TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:01:00,829 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/444bf67b0bc84b5a9e8f59b4e41857c4, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/85227b1f441442cfbffa883b8145e0dc, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6051236aadaf4707b085cddf6124a5a7] into tmpdir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp, totalSize=118.6 K 2023-08-11 06:01:00,830 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 444bf67b0bc84b5a9e8f59b4e41857c4, keycount=71, bloomtype=ROW, size=78.3 K, encoding=NONE, compression=NONE, seqNum=172, earliestPutTs=1691733602393 2023-08-11 06:01:00,830 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 85227b1f441442cfbffa883b8145e0dc, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=198, earliestPutTs=1691733648750 2023-08-11 06:01:00,831 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 6051236aadaf4707b085cddf6124a5a7, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=209, earliestPutTs=1691733658791 2023-08-11 06:01:00,842 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] throttle.PressureAwareThroughputController(145): 53f5d27324a1528d7e414cd4f606e7a6#info#compaction#35 average throughput is 50.62 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 06:01:00,858 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/827ca4a6b93f428c9c4c68ca15d2fb95 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/827ca4a6b93f428c9c4c68ca15d2fb95 2023-08-11 06:01:00,864 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 53f5d27324a1528d7e414cd4f606e7a6/info of 53f5d27324a1528d7e414cd4f606e7a6 into 827ca4a6b93f428c9c4c68ca15d2fb95(size=109.2 K), total size for store is 109.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 06:01:00,864 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:00,864 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6., storeName=53f5d27324a1528d7e414cd4f606e7a6/info, priority=13, startTime=1691733660827; duration=0sec 2023-08-11 06:01:00,865 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:01:10,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:01:10,834 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-11 06:01:10,849 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=235 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/6e4a989b347c46be9822367fc748cde0 2023-08-11 06:01:10,855 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/6e4a989b347c46be9822367fc748cde0 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6e4a989b347c46be9822367fc748cde0 2023-08-11 06:01:10,861 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6e4a989b347c46be9822367fc748cde0, entries=22, sequenceid=235, filesize=27.4 K 2023-08-11 06:01:10,862 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=6.16 KB/6306 for 53f5d27324a1528d7e414cd4f606e7a6 in 28ms, sequenceid=235, compaction requested=false 2023-08-11 06:01:10,862 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:12,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:01:12,845 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 06:01:12,858 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=246 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/ca6f27f7e98b436bb071987551a18473 2023-08-11 06:01:12,864 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/ca6f27f7e98b436bb071987551a18473 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/ca6f27f7e98b436bb071987551a18473 2023-08-11 06:01:12,870 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/ca6f27f7e98b436bb071987551a18473, entries=8, sequenceid=246, filesize=13.0 K 2023-08-11 06:01:12,870 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=53f5d27324a1528d7e414cd4f606e7a6, server=jenkins-hbase4.apache.org,40141,1691733579120 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 06:01:12,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] ipc.CallRunner(144): callId: 238 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:42646 deadline: 1691733682870, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=53f5d27324a1528d7e414cd4f606e7a6, server=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:01:12,871 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for 53f5d27324a1528d7e414cd4f606e7a6 in 26ms, sequenceid=246, compaction requested=true 2023-08-11 06:01:12,871 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:12,871 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:01:12,871 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 06:01:12,872 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 153186 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 06:01:12,873 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1912): 53f5d27324a1528d7e414cd4f606e7a6/info is initiating minor compaction (all files) 2023-08-11 06:01:12,873 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 53f5d27324a1528d7e414cd4f606e7a6/info in TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:01:12,873 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/827ca4a6b93f428c9c4c68ca15d2fb95, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6e4a989b347c46be9822367fc748cde0, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/ca6f27f7e98b436bb071987551a18473] into tmpdir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp, totalSize=149.6 K 2023-08-11 06:01:12,873 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 827ca4a6b93f428c9c4c68ca15d2fb95, keycount=101, bloomtype=ROW, size=109.2 K, encoding=NONE, compression=NONE, seqNum=209, earliestPutTs=1691733602393 2023-08-11 06:01:12,874 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 6e4a989b347c46be9822367fc748cde0, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=235, earliestPutTs=1691733660802 2023-08-11 06:01:12,874 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting ca6f27f7e98b436bb071987551a18473, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=246, earliestPutTs=1691733670835 2023-08-11 06:01:12,887 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] throttle.PressureAwareThroughputController(145): 53f5d27324a1528d7e414cd4f606e7a6#info#compaction#38 average throughput is 65.65 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 06:01:12,906 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/32f54ca76eda456797a1664b2a22a367 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/32f54ca76eda456797a1664b2a22a367 2023-08-11 06:01:12,912 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 53f5d27324a1528d7e414cd4f606e7a6/info of 53f5d27324a1528d7e414cd4f606e7a6 into 32f54ca76eda456797a1664b2a22a367(size=140.4 K), total size for store is 140.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 06:01:12,912 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:12,912 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6., storeName=53f5d27324a1528d7e414cd4f606e7a6/info, priority=13, startTime=1691733672871; duration=0sec 2023-08-11 06:01:12,912 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:01:22,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:01:22,913 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-08-11 06:01:22,923 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=53f5d27324a1528d7e414cd4f606e7a6, server=jenkins-hbase4.apache.org,40141,1691733579120 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-08-11 06:01:22,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] ipc.CallRunner(144): callId: 248 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.14.131:42646 deadline: 1691733692923, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=53f5d27324a1528d7e414cd4f606e7a6, server=jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:01:22,933 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=272 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/49d57a005ba74a37a08fbf98b778db09 2023-08-11 06:01:22,939 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/49d57a005ba74a37a08fbf98b778db09 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/49d57a005ba74a37a08fbf98b778db09 2023-08-11 06:01:22,944 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/49d57a005ba74a37a08fbf98b778db09, entries=22, sequenceid=272, filesize=27.4 K 2023-08-11 06:01:22,945 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=7.18 KB/7357 for 53f5d27324a1528d7e414cd4f606e7a6 in 32ms, sequenceid=272, compaction requested=false 2023-08-11 06:01:22,945 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:32,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:01:32,927 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 06:01:32,939 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=283 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/e5ae0fec8afa4eeea567b144cd58089f 2023-08-11 06:01:32,945 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/e5ae0fec8afa4eeea567b144cd58089f as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/e5ae0fec8afa4eeea567b144cd58089f 2023-08-11 06:01:32,950 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/e5ae0fec8afa4eeea567b144cd58089f, entries=8, sequenceid=283, filesize=13.0 K 2023-08-11 06:01:32,951 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=0 B/0 for 53f5d27324a1528d7e414cd4f606e7a6 in 24ms, sequenceid=283, compaction requested=true 2023-08-11 06:01:32,951 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:32,952 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:01:32,952 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 06:01:32,953 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 185104 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 06:01:32,953 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1912): 53f5d27324a1528d7e414cd4f606e7a6/info is initiating minor compaction (all files) 2023-08-11 06:01:32,953 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 53f5d27324a1528d7e414cd4f606e7a6/info in TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:01:32,953 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/32f54ca76eda456797a1664b2a22a367, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/49d57a005ba74a37a08fbf98b778db09, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/e5ae0fec8afa4eeea567b144cd58089f] into tmpdir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp, totalSize=180.8 K 2023-08-11 06:01:32,953 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 32f54ca76eda456797a1664b2a22a367, keycount=131, bloomtype=ROW, size=140.4 K, encoding=NONE, compression=NONE, seqNum=246, earliestPutTs=1691733602393 2023-08-11 06:01:32,954 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 49d57a005ba74a37a08fbf98b778db09, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=272, earliestPutTs=1691733672846 2023-08-11 06:01:32,954 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting e5ae0fec8afa4eeea567b144cd58089f, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=283, earliestPutTs=1691733682914 2023-08-11 06:01:32,968 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] throttle.PressureAwareThroughputController(145): 53f5d27324a1528d7e414cd4f606e7a6#info#compaction#41 average throughput is 53.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 06:01:32,984 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/a54e128bda6d4ea3a0ad2f0cc26dc9bc as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/a54e128bda6d4ea3a0ad2f0cc26dc9bc 2023-08-11 06:01:32,990 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 53f5d27324a1528d7e414cd4f606e7a6/info of 53f5d27324a1528d7e414cd4f606e7a6 into a54e128bda6d4ea3a0ad2f0cc26dc9bc(size=171.4 K), total size for store is 171.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 06:01:32,990 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:32,990 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6., storeName=53f5d27324a1528d7e414cd4f606e7a6/info, priority=13, startTime=1691733692952; duration=0sec 2023-08-11 06:01:32,990 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:01:34,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:01:34,937 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-08-11 06:01:34,955 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=295 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/77a15aa1e69645adb4a694315c3261ae 2023-08-11 06:01:34,962 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/77a15aa1e69645adb4a694315c3261ae as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/77a15aa1e69645adb4a694315c3261ae 2023-08-11 06:01:34,968 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/77a15aa1e69645adb4a694315c3261ae, entries=8, sequenceid=295, filesize=13.0 K 2023-08-11 06:01:34,969 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=19.50 KB/19969 for 53f5d27324a1528d7e414cd4f606e7a6 in 32ms, sequenceid=295, compaction requested=false 2023-08-11 06:01:34,969 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:34,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40141] regionserver.HRegion(9158): Flush requested on 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:01:34,970 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=20.53 KB heapSize=22.28 KB 2023-08-11 06:01:34,984 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=20.53 KB at sequenceid=318 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/352994277ffc49cd9bf1191027b161b5 2023-08-11 06:01:34,989 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/352994277ffc49cd9bf1191027b161b5 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/352994277ffc49cd9bf1191027b161b5 2023-08-11 06:01:34,994 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/352994277ffc49cd9bf1191027b161b5, entries=20, sequenceid=318, filesize=25.4 K 2023-08-11 06:01:34,995 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~20.53 KB/21020, heapSize ~22.27 KB/22800, currentSize=4.11 KB/4204 for 53f5d27324a1528d7e414cd4f606e7a6 in 25ms, sequenceid=318, compaction requested=true 2023-08-11 06:01:34,995 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:34,995 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:01:34,996 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-08-11 06:01:34,997 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 214726 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-08-11 06:01:34,997 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1912): 53f5d27324a1528d7e414cd4f606e7a6/info is initiating minor compaction (all files) 2023-08-11 06:01:34,997 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 53f5d27324a1528d7e414cd4f606e7a6/info in TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:01:34,997 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/a54e128bda6d4ea3a0ad2f0cc26dc9bc, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/77a15aa1e69645adb4a694315c3261ae, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/352994277ffc49cd9bf1191027b161b5] into tmpdir=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp, totalSize=209.7 K 2023-08-11 06:01:34,998 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting a54e128bda6d4ea3a0ad2f0cc26dc9bc, keycount=161, bloomtype=ROW, size=171.4 K, encoding=NONE, compression=NONE, seqNum=283, earliestPutTs=1691733602393 2023-08-11 06:01:34,998 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 77a15aa1e69645adb4a694315c3261ae, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=295, earliestPutTs=1691733694928 2023-08-11 06:01:34,998 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] compactions.Compactor(207): Compacting 352994277ffc49cd9bf1191027b161b5, keycount=20, bloomtype=ROW, size=25.4 K, encoding=NONE, compression=NONE, seqNum=318, earliestPutTs=1691733694938 2023-08-11 06:01:35,021 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] throttle.PressureAwareThroughputController(145): 53f5d27324a1528d7e414cd4f606e7a6#info#compaction#44 average throughput is 63.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-08-11 06:01:35,045 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/31492959a9c04dd69c59a6bd3763a95b as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/31492959a9c04dd69c59a6bd3763a95b 2023-08-11 06:01:35,051 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 53f5d27324a1528d7e414cd4f606e7a6/info of 53f5d27324a1528d7e414cd4f606e7a6 into 31492959a9c04dd69c59a6bd3763a95b(size=200.3 K), total size for store is 200.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-08-11 06:01:35,051 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:35,051 INFO [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6., storeName=53f5d27324a1528d7e414cd4f606e7a6/info, priority=13, startTime=1691733694995; duration=0sec 2023-08-11 06:01:35,051 DEBUG [RS:0;jenkins-hbase4:40141-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-08-11 06:01:36,975 INFO [Listener at localhost/34697] wal.AbstractTestLogRolling(188): after writing there are 0 log files 2023-08-11 06:01:36,992 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34381,DS-c9721935-3327-4425-9403-cf02de7e1b8b,DISK] 2023-08-11 06:01:37,004 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33717,DS-0fa6580a-a0d6-4400-bacc-1283d3a90e58,DISK] 2023-08-11 06:01:37,008 INFO [Listener at localhost/34697] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120/jenkins-hbase4.apache.org%2C40141%2C1691733579120.1691733579499 with entries=309, filesize=300.61 KB; new WAL /user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120/jenkins-hbase4.apache.org%2C40141%2C1691733579120.1691733696976 2023-08-11 06:01:37,008 DEBUG [Listener at localhost/34697] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34381,DS-c9721935-3327-4425-9403-cf02de7e1b8b,DISK], DatanodeInfoWithStorage[127.0.0.1:33717,DS-0fa6580a-a0d6-4400-bacc-1283d3a90e58,DISK]] 2023-08-11 06:01:37,008 DEBUG [Listener at localhost/34697] wal.AbstractFSWAL(716): hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120/jenkins-hbase4.apache.org%2C40141%2C1691733579120.1691733579499 is not closed yet, will try archiving it next time 2023-08-11 06:01:37,015 DEBUG [Listener at localhost/34697] regionserver.HRegion(2446): Flush status journal for bfdaf387a2b50b5b09026b7604e48753: 2023-08-11 06:01:37,015 INFO [Listener at localhost/34697] regionserver.HRegion(2745): Flushing 53f5d27324a1528d7e414cd4f606e7a6 1/1 column families, dataSize=4.11 KB heapSize=4.66 KB 2023-08-11 06:01:37,035 INFO [Listener at localhost/34697] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.11 KB at sequenceid=326 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/6867c8f36216482eb6dc836c4a6fe9de 2023-08-11 06:01:37,043 DEBUG [Listener at localhost/34697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/.tmp/info/6867c8f36216482eb6dc836c4a6fe9de as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6867c8f36216482eb6dc836c4a6fe9de 2023-08-11 06:01:37,054 INFO [Listener at localhost/34697] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6867c8f36216482eb6dc836c4a6fe9de, entries=4, sequenceid=326, filesize=8.9 K 2023-08-11 06:01:37,057 INFO [Listener at localhost/34697] regionserver.HRegion(2948): Finished flush of dataSize ~4.11 KB/4204, heapSize ~4.64 KB/4752, currentSize=0 B/0 for 53f5d27324a1528d7e414cd4f606e7a6 in 42ms, sequenceid=326, compaction requested=false 2023-08-11 06:01:37,057 DEBUG [Listener at localhost/34697] regionserver.HRegion(2446): Flush status journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:37,057 INFO [Listener at localhost/34697] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.26 KB heapSize=4.19 KB 2023-08-11 06:01:37,080 INFO [Listener at localhost/34697] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.26 KB at sequenceid=24 (bloomFilter=false), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/.tmp/info/aa6113eedf37419082ca3c2c0b32830b 2023-08-11 06:01:37,087 DEBUG [Listener at localhost/34697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/.tmp/info/aa6113eedf37419082ca3c2c0b32830b as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/info/aa6113eedf37419082ca3c2c0b32830b 2023-08-11 06:01:37,093 INFO [Listener at localhost/34697] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/info/aa6113eedf37419082ca3c2c0b32830b, entries=16, sequenceid=24, filesize=7.0 K 2023-08-11 06:01:37,094 INFO [Listener at localhost/34697] regionserver.HRegion(2948): Finished flush of dataSize ~2.26 KB/2312, heapSize ~3.67 KB/3760, currentSize=0 B/0 for 1588230740 in 37ms, sequenceid=24, compaction requested=false 2023-08-11 06:01:37,094 DEBUG [Listener at localhost/34697] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-08-11 06:01:37,095 INFO [Listener at localhost/34697] regionserver.HRegion(2745): Flushing 25247a3d65bbb458b00fea2742ff1977 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-11 06:01:37,512 INFO [Listener at localhost/34697] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977/.tmp/info/ba30f2b6ebd54cf6a6cedcc53df39561 2023-08-11 06:01:37,524 DEBUG [Listener at localhost/34697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977/.tmp/info/ba30f2b6ebd54cf6a6cedcc53df39561 as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977/info/ba30f2b6ebd54cf6a6cedcc53df39561 2023-08-11 06:01:37,529 INFO [Listener at localhost/34697] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977/info/ba30f2b6ebd54cf6a6cedcc53df39561, entries=2, sequenceid=6, filesize=4.8 K 2023-08-11 06:01:37,530 INFO [Listener at localhost/34697] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 25247a3d65bbb458b00fea2742ff1977 in 435ms, sequenceid=6, compaction requested=false 2023-08-11 06:01:37,531 DEBUG [Listener at localhost/34697] regionserver.HRegion(2446): Flush status journal for 25247a3d65bbb458b00fea2742ff1977: 2023-08-11 06:01:37,547 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34381,DS-c9721935-3327-4425-9403-cf02de7e1b8b,DISK] 2023-08-11 06:01:37,548 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33717,DS-0fa6580a-a0d6-4400-bacc-1283d3a90e58,DISK] 2023-08-11 06:01:37,550 INFO [Listener at localhost/34697] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120/jenkins-hbase4.apache.org%2C40141%2C1691733579120.1691733696976 with entries=4, filesize=1.22 KB; new WAL /user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120/jenkins-hbase4.apache.org%2C40141%2C1691733579120.1691733697531 2023-08-11 06:01:37,550 DEBUG [Listener at localhost/34697] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34381,DS-c9721935-3327-4425-9403-cf02de7e1b8b,DISK], DatanodeInfoWithStorage[127.0.0.1:33717,DS-0fa6580a-a0d6-4400-bacc-1283d3a90e58,DISK]] 2023-08-11 06:01:37,551 DEBUG [Listener at localhost/34697] wal.AbstractFSWAL(716): hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120/jenkins-hbase4.apache.org%2C40141%2C1691733579120.1691733696976 is not closed yet, will try archiving it next time 2023-08-11 06:01:37,556 INFO [Listener at localhost/34697] hbase.Waiter(180): Waiting up to [5,000] milli-secs(wait.for.ratio=[1]) 2023-08-11 06:01:37,557 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120/jenkins-hbase4.apache.org%2C40141%2C1691733579120.1691733579499 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/oldWALs/jenkins-hbase4.apache.org%2C40141%2C1691733579120.1691733579499 2023-08-11 06:01:37,560 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/WALs/jenkins-hbase4.apache.org,40141,1691733579120/jenkins-hbase4.apache.org%2C40141%2C1691733579120.1691733696976 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/oldWALs/jenkins-hbase4.apache.org%2C40141%2C1691733579120.1691733696976 2023-08-11 06:01:37,656 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-11 06:01:37,656 INFO [Listener at localhost/34697] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-08-11 06:01:37,657 DEBUG [Listener at localhost/34697] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14abad4e to 127.0.0.1:57410 2023-08-11 06:01:37,657 DEBUG [Listener at localhost/34697] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 06:01:37,657 DEBUG [Listener at localhost/34697] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-11 06:01:37,657 DEBUG [Listener at localhost/34697] util.JVMClusterUtil(257): Found active master hash=1132621678, stopped=false 2023-08-11 06:01:37,657 INFO [Listener at localhost/34697] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36765,1691733579078 2023-08-11 06:01:37,659 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 06:01:37,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 06:01:37,662 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 06:01:37,663 INFO [Listener at localhost/34697] procedure2.ProcedureExecutor(629): Stopping 2023-08-11 06:01:37,663 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:37,663 DEBUG [Listener at localhost/34697] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x731e1362 to 127.0.0.1:57410 2023-08-11 06:01:37,663 DEBUG [Listener at localhost/34697] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 06:01:37,663 INFO [Listener at localhost/34697] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40141,1691733579120' ***** 2023-08-11 06:01:37,663 INFO [Listener at localhost/34697] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-11 06:01:37,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 06:01:37,665 INFO [RS:0;jenkins-hbase4:40141] regionserver.HeapMemoryManager(220): Stopping 2023-08-11 06:01:37,665 INFO [RS:0;jenkins-hbase4:40141] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-11 06:01:37,666 INFO [RS:0;jenkins-hbase4:40141] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-11 06:01:37,666 INFO [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(3305): Received CLOSE for bfdaf387a2b50b5b09026b7604e48753 2023-08-11 06:01:37,666 INFO [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(3305): Received CLOSE for 53f5d27324a1528d7e414cd4f606e7a6 2023-08-11 06:01:37,666 INFO [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(3305): Received CLOSE for 25247a3d65bbb458b00fea2742ff1977 2023-08-11 06:01:37,666 INFO [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:01:37,666 DEBUG [RS:0;jenkins-hbase4:40141] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1839d49a to 127.0.0.1:57410 2023-08-11 06:01:37,666 DEBUG [RS:0;jenkins-hbase4:40141] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 06:01:37,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bfdaf387a2b50b5b09026b7604e48753, disabling compactions & flushes 2023-08-11 06:01:37,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753. 2023-08-11 06:01:37,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753. 2023-08-11 06:01:37,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753. after waiting 0 ms 2023-08-11 06:01:37,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753. 2023-08-11 06:01:37,666 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-11 06:01:37,668 INFO [RS:0;jenkins-hbase4:40141] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-11 06:01:37,668 INFO [RS:0;jenkins-hbase4:40141] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-11 06:01:37,668 INFO [RS:0;jenkins-hbase4:40141] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-11 06:01:37,671 INFO [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-11 06:01:37,671 INFO [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-08-11 06:01:37,671 DEBUG [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(1478): Online Regions={bfdaf387a2b50b5b09026b7604e48753=TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753., 53f5d27324a1528d7e414cd4f606e7a6=TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6., 1588230740=hbase:meta,,1.1588230740, 25247a3d65bbb458b00fea2742ff1977=hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977.} 2023-08-11 06:01:37,671 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 06:01:37,671 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 06:01:37,671 DEBUG [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(1504): Waiting on 1588230740, 25247a3d65bbb458b00fea2742ff1977, 53f5d27324a1528d7e414cd4f606e7a6, bfdaf387a2b50b5b09026b7604e48753 2023-08-11 06:01:37,671 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 06:01:37,672 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 06:01:37,672 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 06:01:37,672 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753/info/d04b124f74c946da9277559dc9bbd102.34ed0bd9014f9dee3551a256122cbeae->hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/d04b124f74c946da9277559dc9bbd102-bottom] to archive 2023-08-11 06:01:37,677 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-11 06:01:37,681 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753/info/d04b124f74c946da9277559dc9bbd102.34ed0bd9014f9dee3551a256122cbeae to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753/info/d04b124f74c946da9277559dc9bbd102.34ed0bd9014f9dee3551a256122cbeae 2023-08-11 06:01:37,687 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/meta/1588230740/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-08-11 06:01:37,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 06:01:37,689 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 06:01:37,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 06:01:37,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-11 06:01:37,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/bfdaf387a2b50b5b09026b7604e48753/recovered.edits/117.seqid, newMaxSeqId=117, maxSeqId=112 2023-08-11 06:01:37,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753. 2023-08-11 06:01:37,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bfdaf387a2b50b5b09026b7604e48753: 2023-08-11 06:01:37,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,,1691733604524.bfdaf387a2b50b5b09026b7604e48753. 2023-08-11 06:01:37,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 53f5d27324a1528d7e414cd4f606e7a6, disabling compactions & flushes 2023-08-11 06:01:37,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:01:37,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:01:37,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. after waiting 0 ms 2023-08-11 06:01:37,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:01:37,721 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/d04b124f74c946da9277559dc9bbd102.34ed0bd9014f9dee3551a256122cbeae->hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/34ed0bd9014f9dee3551a256122cbeae/info/d04b124f74c946da9277559dc9bbd102-top, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/997a15100f6e491b8ae8b9742c160272, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/TestLogRolling-testLogRolling=34ed0bd9014f9dee3551a256122cbeae-f915960e9bff441e873dfc3e205bfe53, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/a5d1e49c7cbe4df48d00a1d7bfe27411, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/b2ee59f63a6d44bcb698a648153aca89, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/d0348e675428400ba4720d04460510a9, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/c06d6619846c49fd9c45527685064d2f, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/444bf67b0bc84b5a9e8f59b4e41857c4, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/9b5ecce4504447bf8549349daf2d7244, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/85227b1f441442cfbffa883b8145e0dc, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/827ca4a6b93f428c9c4c68ca15d2fb95, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6051236aadaf4707b085cddf6124a5a7, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6e4a989b347c46be9822367fc748cde0, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/32f54ca76eda456797a1664b2a22a367, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/ca6f27f7e98b436bb071987551a18473, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/49d57a005ba74a37a08fbf98b778db09, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/a54e128bda6d4ea3a0ad2f0cc26dc9bc, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/e5ae0fec8afa4eeea567b144cd58089f, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/77a15aa1e69645adb4a694315c3261ae, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/352994277ffc49cd9bf1191027b161b5] to archive 2023-08-11 06:01:37,722 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-08-11 06:01:37,724 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/d04b124f74c946da9277559dc9bbd102.34ed0bd9014f9dee3551a256122cbeae to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/d04b124f74c946da9277559dc9bbd102.34ed0bd9014f9dee3551a256122cbeae 2023-08-11 06:01:37,725 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/997a15100f6e491b8ae8b9742c160272 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/997a15100f6e491b8ae8b9742c160272 2023-08-11 06:01:37,727 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/TestLogRolling-testLogRolling=34ed0bd9014f9dee3551a256122cbeae-f915960e9bff441e873dfc3e205bfe53 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/TestLogRolling-testLogRolling=34ed0bd9014f9dee3551a256122cbeae-f915960e9bff441e873dfc3e205bfe53 2023-08-11 06:01:37,728 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/a5d1e49c7cbe4df48d00a1d7bfe27411 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/a5d1e49c7cbe4df48d00a1d7bfe27411 2023-08-11 06:01:37,730 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/b2ee59f63a6d44bcb698a648153aca89 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/b2ee59f63a6d44bcb698a648153aca89 2023-08-11 06:01:37,731 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/d0348e675428400ba4720d04460510a9 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/d0348e675428400ba4720d04460510a9 2023-08-11 06:01:37,733 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/c06d6619846c49fd9c45527685064d2f to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/c06d6619846c49fd9c45527685064d2f 2023-08-11 06:01:37,734 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/444bf67b0bc84b5a9e8f59b4e41857c4 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/444bf67b0bc84b5a9e8f59b4e41857c4 2023-08-11 06:01:37,735 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/9b5ecce4504447bf8549349daf2d7244 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/9b5ecce4504447bf8549349daf2d7244 2023-08-11 06:01:37,737 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/85227b1f441442cfbffa883b8145e0dc to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/85227b1f441442cfbffa883b8145e0dc 2023-08-11 06:01:37,740 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/827ca4a6b93f428c9c4c68ca15d2fb95 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/827ca4a6b93f428c9c4c68ca15d2fb95 2023-08-11 06:01:37,742 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6051236aadaf4707b085cddf6124a5a7 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6051236aadaf4707b085cddf6124a5a7 2023-08-11 06:01:37,743 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6e4a989b347c46be9822367fc748cde0 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/6e4a989b347c46be9822367fc748cde0 2023-08-11 06:01:37,750 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/32f54ca76eda456797a1664b2a22a367 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/32f54ca76eda456797a1664b2a22a367 2023-08-11 06:01:37,751 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/ca6f27f7e98b436bb071987551a18473 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/ca6f27f7e98b436bb071987551a18473 2023-08-11 06:01:37,753 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/49d57a005ba74a37a08fbf98b778db09 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/49d57a005ba74a37a08fbf98b778db09 2023-08-11 06:01:37,755 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/a54e128bda6d4ea3a0ad2f0cc26dc9bc to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/a54e128bda6d4ea3a0ad2f0cc26dc9bc 2023-08-11 06:01:37,756 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/e5ae0fec8afa4eeea567b144cd58089f to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/e5ae0fec8afa4eeea567b144cd58089f 2023-08-11 06:01:37,757 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/77a15aa1e69645adb4a694315c3261ae to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/77a15aa1e69645adb4a694315c3261ae 2023-08-11 06:01:37,759 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/352994277ffc49cd9bf1191027b161b5 to hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/archive/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/info/352994277ffc49cd9bf1191027b161b5 2023-08-11 06:01:37,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/default/TestLogRolling-testLogRolling/53f5d27324a1528d7e414cd4f606e7a6/recovered.edits/329.seqid, newMaxSeqId=329, maxSeqId=112 2023-08-11 06:01:37,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:01:37,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 53f5d27324a1528d7e414cd4f606e7a6: 2023-08-11 06:01:37,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,row0064,1691733604524.53f5d27324a1528d7e414cd4f606e7a6. 2023-08-11 06:01:37,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 25247a3d65bbb458b00fea2742ff1977, disabling compactions & flushes 2023-08-11 06:01:37,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. 2023-08-11 06:01:37,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. 2023-08-11 06:01:37,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. after waiting 0 ms 2023-08-11 06:01:37,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. 2023-08-11 06:01:37,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/data/hbase/namespace/25247a3d65bbb458b00fea2742ff1977/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-11 06:01:37,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. 2023-08-11 06:01:37,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 25247a3d65bbb458b00fea2742ff1977: 2023-08-11 06:01:37,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1691733579696.25247a3d65bbb458b00fea2742ff1977. 2023-08-11 06:01:37,872 INFO [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40141,1691733579120; all regions closed. 2023-08-11 06:01:37,880 DEBUG [RS:0;jenkins-hbase4:40141] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/oldWALs 2023-08-11 06:01:37,880 INFO [RS:0;jenkins-hbase4:40141] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40141%2C1691733579120.meta:.meta(num 1691733579640) 2023-08-11 06:01:37,887 DEBUG [RS:0;jenkins-hbase4:40141] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/oldWALs 2023-08-11 06:01:37,887 INFO [RS:0;jenkins-hbase4:40141] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40141%2C1691733579120:(num 1691733697531) 2023-08-11 06:01:37,887 DEBUG [RS:0;jenkins-hbase4:40141] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 06:01:37,887 INFO [RS:0;jenkins-hbase4:40141] regionserver.LeaseManager(133): Closed leases 2023-08-11 06:01:37,888 INFO [RS:0;jenkins-hbase4:40141] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-08-11 06:01:37,888 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 06:01:37,889 INFO [RS:0;jenkins-hbase4:40141] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40141 2023-08-11 06:01:37,890 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40141,1691733579120 2023-08-11 06:01:37,890 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 06:01:37,890 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 06:01:37,897 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40141,1691733579120] 2023-08-11 06:01:37,897 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40141,1691733579120; numProcessing=1 2023-08-11 06:01:37,899 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40141,1691733579120 already deleted, retry=false 2023-08-11 06:01:37,899 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40141,1691733579120 expired; onlineServers=0 2023-08-11 06:01:37,899 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36765,1691733579078' ***** 2023-08-11 06:01:37,899 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-11 06:01:37,900 DEBUG [M:0;jenkins-hbase4:36765] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47bde3c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 06:01:37,900 INFO [M:0;jenkins-hbase4:36765] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36765,1691733579078 2023-08-11 06:01:37,900 INFO [M:0;jenkins-hbase4:36765] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36765,1691733579078; all regions closed. 2023-08-11 06:01:37,900 DEBUG [M:0;jenkins-hbase4:36765] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 06:01:37,900 DEBUG [M:0;jenkins-hbase4:36765] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-11 06:01:37,900 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-11 06:01:37,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691733579274] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691733579274,5,FailOnTimeoutGroup] 2023-08-11 06:01:37,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691733579274] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691733579274,5,FailOnTimeoutGroup] 2023-08-11 06:01:37,900 DEBUG [M:0;jenkins-hbase4:36765] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-11 06:01:37,901 INFO [M:0;jenkins-hbase4:36765] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-11 06:01:37,901 INFO [M:0;jenkins-hbase4:36765] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-11 06:01:37,902 INFO [M:0;jenkins-hbase4:36765] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-11 06:01:37,902 DEBUG [M:0;jenkins-hbase4:36765] master.HMaster(1512): Stopping service threads 2023-08-11 06:01:37,902 INFO [M:0;jenkins-hbase4:36765] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-11 06:01:37,902 ERROR [M:0;jenkins-hbase4:36765] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-08-11 06:01:37,902 INFO [M:0;jenkins-hbase4:36765] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-11 06:01:37,902 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-11 06:01:37,902 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-11 06:01:37,902 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:37,902 DEBUG [M:0;jenkins-hbase4:36765] zookeeper.ZKUtil(398): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-11 06:01:37,902 WARN [M:0;jenkins-hbase4:36765] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-11 06:01:37,903 INFO [M:0;jenkins-hbase4:36765] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-11 06:01:37,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 06:01:37,907 INFO [M:0;jenkins-hbase4:36765] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-11 06:01:37,907 DEBUG [M:0;jenkins-hbase4:36765] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 06:01:37,907 INFO [M:0;jenkins-hbase4:36765] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 06:01:37,907 DEBUG [M:0;jenkins-hbase4:36765] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 06:01:37,907 DEBUG [M:0;jenkins-hbase4:36765] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 06:01:37,907 DEBUG [M:0;jenkins-hbase4:36765] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 06:01:37,907 INFO [M:0;jenkins-hbase4:36765] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=64.69 KB heapSize=78.42 KB 2023-08-11 06:01:37,929 INFO [M:0;jenkins-hbase4:36765] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64.69 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fd6e48ec23d84d39b66b2e52f33c63ec 2023-08-11 06:01:37,934 INFO [M:0;jenkins-hbase4:36765] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fd6e48ec23d84d39b66b2e52f33c63ec 2023-08-11 06:01:37,935 DEBUG [M:0;jenkins-hbase4:36765] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fd6e48ec23d84d39b66b2e52f33c63ec as hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fd6e48ec23d84d39b66b2e52f33c63ec 2023-08-11 06:01:37,940 INFO [M:0;jenkins-hbase4:36765] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fd6e48ec23d84d39b66b2e52f33c63ec 2023-08-11 06:01:37,940 INFO [M:0;jenkins-hbase4:36765] regionserver.HStore(1080): Added hdfs://localhost:39409/user/jenkins/test-data/aa87af23-3095-7633-9d9b-9555ad07a32e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fd6e48ec23d84d39b66b2e52f33c63ec, entries=18, sequenceid=160, filesize=6.9 K 2023-08-11 06:01:37,941 INFO [M:0;jenkins-hbase4:36765] regionserver.HRegion(2948): Finished flush of dataSize ~64.69 KB/66244, heapSize ~78.41 KB/80288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 34ms, sequenceid=160, compaction requested=false 2023-08-11 06:01:37,943 INFO [M:0;jenkins-hbase4:36765] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 06:01:37,943 DEBUG [M:0;jenkins-hbase4:36765] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 06:01:37,946 INFO [M:0;jenkins-hbase4:36765] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-11 06:01:37,946 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 06:01:37,947 INFO [M:0;jenkins-hbase4:36765] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36765 2023-08-11 06:01:37,949 DEBUG [M:0;jenkins-hbase4:36765] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36765,1691733579078 already deleted, retry=false 2023-08-11 06:01:37,997 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 06:01:37,998 INFO [RS:0;jenkins-hbase4:40141] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40141,1691733579120; zookeeper connection closed. 2023-08-11 06:01:37,998 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): regionserver:40141-0x101f29c58340001, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 06:01:37,998 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@285bd8e1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@285bd8e1 2023-08-11 06:01:37,999 INFO [Listener at localhost/34697] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-11 06:01:38,098 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 06:01:38,098 INFO [M:0;jenkins-hbase4:36765] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36765,1691733579078; zookeeper connection closed. 2023-08-11 06:01:38,098 DEBUG [Listener at localhost/34697-EventThread] zookeeper.ZKWatcher(600): master:36765-0x101f29c58340000, quorum=127.0.0.1:57410, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 06:01:38,099 WARN [Listener at localhost/34697] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 06:01:38,103 INFO [Listener at localhost/34697] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 06:01:38,208 WARN [BP-846741827-172.31.14.131-1691733578513 heartbeating to localhost/127.0.0.1:39409] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 06:01:38,209 WARN [BP-846741827-172.31.14.131-1691733578513 heartbeating to localhost/127.0.0.1:39409] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-846741827-172.31.14.131-1691733578513 (Datanode Uuid 5e0765af-4de6-48f3-b5b5-88dc5b79d562) service to localhost/127.0.0.1:39409 2023-08-11 06:01:38,209 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/cluster_68b6fc60-97df-e8da-54d2-fb3a5ba5f9fd/dfs/data/data3/current/BP-846741827-172.31.14.131-1691733578513] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 06:01:38,210 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/cluster_68b6fc60-97df-e8da-54d2-fb3a5ba5f9fd/dfs/data/data4/current/BP-846741827-172.31.14.131-1691733578513] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 06:01:38,211 WARN [Listener at localhost/34697] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 06:01:38,214 INFO [Listener at localhost/34697] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 06:01:38,318 WARN [BP-846741827-172.31.14.131-1691733578513 heartbeating to localhost/127.0.0.1:39409] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 06:01:38,318 WARN [BP-846741827-172.31.14.131-1691733578513 heartbeating to localhost/127.0.0.1:39409] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-846741827-172.31.14.131-1691733578513 (Datanode Uuid 14c0f07f-defc-4512-b862-141a3a37ee13) service to localhost/127.0.0.1:39409 2023-08-11 06:01:38,319 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/cluster_68b6fc60-97df-e8da-54d2-fb3a5ba5f9fd/dfs/data/data1/current/BP-846741827-172.31.14.131-1691733578513] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 06:01:38,319 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/cluster_68b6fc60-97df-e8da-54d2-fb3a5ba5f9fd/dfs/data/data2/current/BP-846741827-172.31.14.131-1691733578513] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 06:01:38,329 INFO [Listener at localhost/34697] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 06:01:38,446 INFO [Listener at localhost/34697] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-11 06:01:38,478 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-11 06:01:38,488 INFO [Listener at localhost/34697] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=76 (was 65) - Thread LEAK? -, OpenFileDescriptor=478 (was 436) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=166 (was 85) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=2826 (was 2897) 2023-08-11 06:01:38,496 INFO [Listener at localhost/34697] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=77, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=166, ProcessCount=171, AvailableMemoryMB=2826 2023-08-11 06:01:38,496 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-08-11 06:01:38,496 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/hadoop.log.dir so I do NOT create it in target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6 2023-08-11 06:01:38,497 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a9113558-e09e-303a-0a54-11097221d802/hadoop.tmp.dir so I do NOT create it in target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6 2023-08-11 06:01:38,497 INFO [Listener at localhost/34697] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/cluster_8a1a2fb7-458f-650a-32ca-643a5274df35, deleteOnExit=true 2023-08-11 06:01:38,497 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-08-11 06:01:38,497 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/test.cache.data in system properties and HBase conf 2023-08-11 06:01:38,497 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/hadoop.tmp.dir in system properties and HBase conf 2023-08-11 06:01:38,497 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/hadoop.log.dir in system properties and HBase conf 2023-08-11 06:01:38,497 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-08-11 06:01:38,497 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-08-11 06:01:38,497 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-08-11 06:01:38,497 DEBUG [Listener at localhost/34697] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-08-11 06:01:38,498 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-08-11 06:01:38,498 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-08-11 06:01:38,498 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-08-11 06:01:38,498 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 06:01:38,498 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-08-11 06:01:38,498 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-08-11 06:01:38,498 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-08-11 06:01:38,498 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 06:01:38,498 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-08-11 06:01:38,499 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/nfs.dump.dir in system properties and HBase conf 2023-08-11 06:01:38,499 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/java.io.tmpdir in system properties and HBase conf 2023-08-11 06:01:38,499 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-08-11 06:01:38,499 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-08-11 06:01:38,499 INFO [Listener at localhost/34697] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-08-11 06:01:38,503 WARN [Listener at localhost/34697] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 06:01:38,503 WARN [Listener at localhost/34697] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 06:01:38,543 WARN [Listener at localhost/34697] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 06:01:38,546 INFO [Listener at localhost/34697] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 06:01:38,550 INFO [Listener at localhost/34697] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/java.io.tmpdir/Jetty_localhost_36313_hdfs____m72lfg/webapp 2023-08-11 06:01:38,641 INFO [Listener at localhost/34697] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36313 2023-08-11 06:01:38,646 WARN [Listener at localhost/34697] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-08-11 06:01:38,646 WARN [Listener at localhost/34697] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-08-11 06:01:38,687 WARN [Listener at localhost/40121] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 06:01:38,697 WARN [Listener at localhost/40121] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 06:01:38,699 WARN [Listener at localhost/40121] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 06:01:38,700 INFO [Listener at localhost/40121] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 06:01:38,704 INFO [Listener at localhost/40121] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/java.io.tmpdir/Jetty_localhost_43217_datanode____.4niuu8/webapp 2023-08-11 06:01:38,796 INFO [Listener at localhost/40121] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43217 2023-08-11 06:01:38,801 WARN [Listener at localhost/40827] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 06:01:38,812 WARN [Listener at localhost/40827] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-08-11 06:01:38,814 WARN [Listener at localhost/40827] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-08-11 06:01:38,815 INFO [Listener at localhost/40827] log.Slf4jLog(67): jetty-6.1.26 2023-08-11 06:01:38,819 INFO [Listener at localhost/40827] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/java.io.tmpdir/Jetty_localhost_40385_datanode____.37p2n9/webapp 2023-08-11 06:01:38,893 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf75aed681ac56935: Processing first storage report for DS-ea967fbf-9436-44ab-ba5d-41323b2b5325 from datanode 09a94acd-7f56-402f-9024-5dad8f512198 2023-08-11 06:01:38,894 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf75aed681ac56935: from storage DS-ea967fbf-9436-44ab-ba5d-41323b2b5325 node DatanodeRegistration(127.0.0.1:35009, datanodeUuid=09a94acd-7f56-402f-9024-5dad8f512198, infoPort=35881, infoSecurePort=0, ipcPort=40827, storageInfo=lv=-57;cid=testClusterID;nsid=1861700128;c=1691733698506), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 06:01:38,894 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf75aed681ac56935: Processing first storage report for DS-5d47d356-a889-4465-8b37-2b5477325e74 from datanode 09a94acd-7f56-402f-9024-5dad8f512198 2023-08-11 06:01:38,894 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf75aed681ac56935: from storage DS-5d47d356-a889-4465-8b37-2b5477325e74 node DatanodeRegistration(127.0.0.1:35009, datanodeUuid=09a94acd-7f56-402f-9024-5dad8f512198, infoPort=35881, infoSecurePort=0, ipcPort=40827, storageInfo=lv=-57;cid=testClusterID;nsid=1861700128;c=1691733698506), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 06:01:38,915 INFO [Listener at localhost/40827] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40385 2023-08-11 06:01:38,921 WARN [Listener at localhost/38347] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-08-11 06:01:39,010 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4c7dcebd3b7bb130: Processing first storage report for DS-c957b324-0fcd-4415-a588-ff301cc9bd8a from datanode f420e3c3-d263-4415-9254-15350bb08996 2023-08-11 06:01:39,010 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4c7dcebd3b7bb130: from storage DS-c957b324-0fcd-4415-a588-ff301cc9bd8a node DatanodeRegistration(127.0.0.1:38511, datanodeUuid=f420e3c3-d263-4415-9254-15350bb08996, infoPort=44957, infoSecurePort=0, ipcPort=38347, storageInfo=lv=-57;cid=testClusterID;nsid=1861700128;c=1691733698506), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 06:01:39,010 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4c7dcebd3b7bb130: Processing first storage report for DS-dacc538b-2b3e-448c-be50-e18245c95160 from datanode f420e3c3-d263-4415-9254-15350bb08996 2023-08-11 06:01:39,010 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4c7dcebd3b7bb130: from storage DS-dacc538b-2b3e-448c-be50-e18245c95160 node DatanodeRegistration(127.0.0.1:38511, datanodeUuid=f420e3c3-d263-4415-9254-15350bb08996, infoPort=44957, infoSecurePort=0, ipcPort=38347, storageInfo=lv=-57;cid=testClusterID;nsid=1861700128;c=1691733698506), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-08-11 06:01:39,027 DEBUG [Listener at localhost/38347] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6 2023-08-11 06:01:39,029 INFO [Listener at localhost/38347] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/cluster_8a1a2fb7-458f-650a-32ca-643a5274df35/zookeeper_0, clientPort=57159, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/cluster_8a1a2fb7-458f-650a-32ca-643a5274df35/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/cluster_8a1a2fb7-458f-650a-32ca-643a5274df35/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-08-11 06:01:39,030 INFO [Listener at localhost/38347] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57159 2023-08-11 06:01:39,031 INFO [Listener at localhost/38347] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 06:01:39,031 INFO [Listener at localhost/38347] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 06:01:39,047 INFO [Listener at localhost/38347] util.FSUtils(471): Created version file at hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4 with version=8 2023-08-11 06:01:39,047 INFO [Listener at localhost/38347] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:36289/user/jenkins/test-data/5f3c26e3-e5e2-ecf3-2b13-d791c4e9a032/hbase-staging 2023-08-11 06:01:39,048 INFO [Listener at localhost/38347] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 06:01:39,049 INFO [Listener at localhost/38347] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 06:01:39,049 INFO [Listener at localhost/38347] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 06:01:39,049 INFO [Listener at localhost/38347] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 06:01:39,049 INFO [Listener at localhost/38347] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 06:01:39,049 INFO [Listener at localhost/38347] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 06:01:39,049 INFO [Listener at localhost/38347] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 06:01:39,050 INFO [Listener at localhost/38347] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41211 2023-08-11 06:01:39,051 INFO [Listener at localhost/38347] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 06:01:39,052 INFO [Listener at localhost/38347] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 06:01:39,053 INFO [Listener at localhost/38347] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41211 connecting to ZooKeeper ensemble=127.0.0.1:57159 2023-08-11 06:01:39,061 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:412110x0, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 06:01:39,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41211-0x101f29e2cd80000 connected 2023-08-11 06:01:39,081 DEBUG [Listener at localhost/38347] zookeeper.ZKUtil(164): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 06:01:39,082 DEBUG [Listener at localhost/38347] zookeeper.ZKUtil(164): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 06:01:39,082 DEBUG [Listener at localhost/38347] zookeeper.ZKUtil(164): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 06:01:39,082 DEBUG [Listener at localhost/38347] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41211 2023-08-11 06:01:39,083 DEBUG [Listener at localhost/38347] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41211 2023-08-11 06:01:39,084 DEBUG [Listener at localhost/38347] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41211 2023-08-11 06:01:39,084 DEBUG [Listener at localhost/38347] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41211 2023-08-11 06:01:39,084 DEBUG [Listener at localhost/38347] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41211 2023-08-11 06:01:39,084 INFO [Listener at localhost/38347] master.HMaster(444): hbase.rootdir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4, hbase.cluster.distributed=false 2023-08-11 06:01:39,097 INFO [Listener at localhost/38347] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-08-11 06:01:39,097 INFO [Listener at localhost/38347] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 06:01:39,097 INFO [Listener at localhost/38347] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-08-11 06:01:39,097 INFO [Listener at localhost/38347] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-08-11 06:01:39,098 INFO [Listener at localhost/38347] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-08-11 06:01:39,098 INFO [Listener at localhost/38347] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-08-11 06:01:39,098 INFO [Listener at localhost/38347] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-08-11 06:01:39,103 INFO [Listener at localhost/38347] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36353 2023-08-11 06:01:39,103 INFO [Listener at localhost/38347] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-08-11 06:01:39,104 DEBUG [Listener at localhost/38347] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-08-11 06:01:39,105 INFO [Listener at localhost/38347] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 06:01:39,106 INFO [Listener at localhost/38347] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 06:01:39,106 INFO [Listener at localhost/38347] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36353 connecting to ZooKeeper ensemble=127.0.0.1:57159 2023-08-11 06:01:39,113 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): regionserver:363530x0, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-08-11 06:01:39,114 DEBUG [Listener at localhost/38347] zookeeper.ZKUtil(164): regionserver:363530x0, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 06:01:39,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36353-0x101f29e2cd80001 connected 2023-08-11 06:01:39,115 DEBUG [Listener at localhost/38347] zookeeper.ZKUtil(164): regionserver:36353-0x101f29e2cd80001, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 06:01:39,116 DEBUG [Listener at localhost/38347] zookeeper.ZKUtil(164): regionserver:36353-0x101f29e2cd80001, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-08-11 06:01:39,118 DEBUG [Listener at localhost/38347] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36353 2023-08-11 06:01:39,119 DEBUG [Listener at localhost/38347] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36353 2023-08-11 06:01:39,119 DEBUG [Listener at localhost/38347] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36353 2023-08-11 06:01:39,119 DEBUG [Listener at localhost/38347] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36353 2023-08-11 06:01:39,120 DEBUG [Listener at localhost/38347] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36353 2023-08-11 06:01:39,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41211,1691733699048 2023-08-11 06:01:39,122 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 06:01:39,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41211,1691733699048 2023-08-11 06:01:39,125 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 06:01:39,125 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): regionserver:36353-0x101f29e2cd80001, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-08-11 06:01:39,125 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:39,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 06:01:39,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41211,1691733699048 from backup master directory 2023-08-11 06:01:39,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-08-11 06:01:39,128 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41211,1691733699048 2023-08-11 06:01:39,128 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-08-11 06:01:39,128 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 06:01:39,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41211,1691733699048 2023-08-11 06:01:39,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/hbase.id with ID: 1fb2e1d4-86bf-4198-9b35-9942cd56a32c 2023-08-11 06:01:39,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 06:01:39,161 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:39,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x69af507a to 127.0.0.1:57159 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 06:01:39,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68da2cc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 06:01:39,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-08-11 06:01:39,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-08-11 06:01:39,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 06:01:39,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/data/master/store-tmp 2023-08-11 06:01:39,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 06:01:39,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 06:01:39,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 06:01:39,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 06:01:39,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 06:01:39,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 06:01:39,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 06:01:39,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 06:01:39,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/WALs/jenkins-hbase4.apache.org,41211,1691733699048 2023-08-11 06:01:39,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41211%2C1691733699048, suffix=, logDir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/WALs/jenkins-hbase4.apache.org,41211,1691733699048, archiveDir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/oldWALs, maxLogs=10 2023-08-11 06:01:39,200 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35009,DS-ea967fbf-9436-44ab-ba5d-41323b2b5325,DISK] 2023-08-11 06:01:39,200 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38511,DS-c957b324-0fcd-4415-a588-ff301cc9bd8a,DISK] 2023-08-11 06:01:39,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/WALs/jenkins-hbase4.apache.org,41211,1691733699048/jenkins-hbase4.apache.org%2C41211%2C1691733699048.1691733699186 2023-08-11 06:01:39,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35009,DS-ea967fbf-9436-44ab-ba5d-41323b2b5325,DISK], DatanodeInfoWithStorage[127.0.0.1:38511,DS-c957b324-0fcd-4415-a588-ff301cc9bd8a,DISK]] 2023-08-11 06:01:39,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-08-11 06:01:39,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 06:01:39,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 06:01:39,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 06:01:39,205 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-08-11 06:01:39,207 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-08-11 06:01:39,207 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-08-11 06:01:39,208 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 06:01:39,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 06:01:39,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-08-11 06:01:39,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-08-11 06:01:39,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 06:01:39,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=858304, jitterRate=0.09139086306095123}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 06:01:39,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 06:01:39,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-08-11 06:01:39,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-08-11 06:01:39,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-08-11 06:01:39,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-08-11 06:01:39,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-08-11 06:01:39,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-08-11 06:01:39,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-08-11 06:01:39,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-08-11 06:01:39,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-08-11 06:01:39,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-08-11 06:01:39,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-08-11 06:01:39,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-08-11 06:01:39,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-08-11 06:01:39,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-08-11 06:01:39,230 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:39,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-08-11 06:01:39,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-08-11 06:01:39,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-08-11 06:01:39,233 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 06:01:39,233 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): regionserver:36353-0x101f29e2cd80001, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-08-11 06:01:39,233 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:39,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41211,1691733699048, sessionid=0x101f29e2cd80000, setting cluster-up flag (Was=false) 2023-08-11 06:01:39,237 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:39,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-08-11 06:01:39,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41211,1691733699048 2023-08-11 06:01:39,247 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:39,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-08-11 06:01:39,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41211,1691733699048 2023-08-11 06:01:39,251 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/.hbase-snapshot/.tmp 2023-08-11 06:01:39,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-08-11 06:01:39,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 06:01:39,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 06:01:39,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 06:01:39,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-08-11 06:01:39,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-08-11 06:01:39,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 06:01:39,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 06:01:39,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 06:01:39,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1691733729255 2023-08-11 06:01:39,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-08-11 06:01:39,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-08-11 06:01:39,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-08-11 06:01:39,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-08-11 06:01:39,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-08-11 06:01:39,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-08-11 06:01:39,255 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 06:01:39,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,255 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-08-11 06:01:39,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-08-11 06:01:39,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-08-11 06:01:39,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-08-11 06:01:39,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-08-11 06:01:39,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-08-11 06:01:39,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691733699256,5,FailOnTimeoutGroup] 2023-08-11 06:01:39,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691733699257,5,FailOnTimeoutGroup] 2023-08-11 06:01:39,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-08-11 06:01:39,257 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 06:01:39,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,265 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 06:01:39,266 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-08-11 06:01:39,266 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4 2023-08-11 06:01:39,273 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 06:01:39,274 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 06:01:39,276 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/info 2023-08-11 06:01:39,276 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 06:01:39,277 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 06:01:39,277 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 06:01:39,278 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/rep_barrier 2023-08-11 06:01:39,278 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 06:01:39,279 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 06:01:39,279 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 06:01:39,280 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/table 2023-08-11 06:01:39,280 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 06:01:39,281 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 06:01:39,281 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740 2023-08-11 06:01:39,282 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740 2023-08-11 06:01:39,284 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 06:01:39,285 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 06:01:39,287 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 06:01:39,287 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=705051, jitterRate=-0.10348215699195862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 06:01:39,287 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 06:01:39,287 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 06:01:39,287 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 06:01:39,287 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 06:01:39,287 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 06:01:39,287 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 06:01:39,288 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 06:01:39,288 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 06:01:39,288 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-08-11 06:01:39,288 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-08-11 06:01:39,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-08-11 06:01:39,290 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-08-11 06:01:39,291 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-08-11 06:01:39,321 INFO [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(951): ClusterId : 1fb2e1d4-86bf-4198-9b35-9942cd56a32c 2023-08-11 06:01:39,322 DEBUG [RS:0;jenkins-hbase4:36353] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-08-11 06:01:39,325 DEBUG [RS:0;jenkins-hbase4:36353] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-08-11 06:01:39,325 DEBUG [RS:0;jenkins-hbase4:36353] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-08-11 06:01:39,327 DEBUG [RS:0;jenkins-hbase4:36353] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-08-11 06:01:39,328 DEBUG [RS:0;jenkins-hbase4:36353] zookeeper.ReadOnlyZKClient(139): Connect 0x0ced259e to 127.0.0.1:57159 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 06:01:39,331 DEBUG [RS:0;jenkins-hbase4:36353] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22aca73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 06:01:39,331 DEBUG [RS:0;jenkins-hbase4:36353] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6154eee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 06:01:39,340 DEBUG [RS:0;jenkins-hbase4:36353] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36353 2023-08-11 06:01:39,340 INFO [RS:0;jenkins-hbase4:36353] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-08-11 06:01:39,340 INFO [RS:0;jenkins-hbase4:36353] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-08-11 06:01:39,340 DEBUG [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(1022): About to register with Master. 2023-08-11 06:01:39,341 INFO [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41211,1691733699048 with isa=jenkins-hbase4.apache.org/172.31.14.131:36353, startcode=1691733699097 2023-08-11 06:01:39,341 DEBUG [RS:0;jenkins-hbase4:36353] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-08-11 06:01:39,343 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40413, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-08-11 06:01:39,344 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41211] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36353,1691733699097 2023-08-11 06:01:39,344 DEBUG [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4 2023-08-11 06:01:39,344 DEBUG [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40121 2023-08-11 06:01:39,344 DEBUG [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-08-11 06:01:39,345 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 06:01:39,346 DEBUG [RS:0;jenkins-hbase4:36353] zookeeper.ZKUtil(162): regionserver:36353-0x101f29e2cd80001, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36353,1691733699097 2023-08-11 06:01:39,346 WARN [RS:0;jenkins-hbase4:36353] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-08-11 06:01:39,346 INFO [RS:0;jenkins-hbase4:36353] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 06:01:39,346 DEBUG [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/WALs/jenkins-hbase4.apache.org,36353,1691733699097 2023-08-11 06:01:39,348 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36353,1691733699097] 2023-08-11 06:01:39,351 DEBUG [RS:0;jenkins-hbase4:36353] zookeeper.ZKUtil(162): regionserver:36353-0x101f29e2cd80001, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36353,1691733699097 2023-08-11 06:01:39,351 DEBUG [RS:0;jenkins-hbase4:36353] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-08-11 06:01:39,351 INFO [RS:0;jenkins-hbase4:36353] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-08-11 06:01:39,353 INFO [RS:0;jenkins-hbase4:36353] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-08-11 06:01:39,353 INFO [RS:0;jenkins-hbase4:36353] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-08-11 06:01:39,353 INFO [RS:0;jenkins-hbase4:36353] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,353 INFO [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-08-11 06:01:39,354 INFO [RS:0;jenkins-hbase4:36353] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,354 DEBUG [RS:0;jenkins-hbase4:36353] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 06:01:39,354 DEBUG [RS:0;jenkins-hbase4:36353] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 06:01:39,354 DEBUG [RS:0;jenkins-hbase4:36353] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 06:01:39,354 DEBUG [RS:0;jenkins-hbase4:36353] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 06:01:39,354 DEBUG [RS:0;jenkins-hbase4:36353] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 06:01:39,354 DEBUG [RS:0;jenkins-hbase4:36353] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-08-11 06:01:39,355 DEBUG [RS:0;jenkins-hbase4:36353] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 06:01:39,355 DEBUG [RS:0;jenkins-hbase4:36353] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 06:01:39,355 DEBUG [RS:0;jenkins-hbase4:36353] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 06:01:39,355 DEBUG [RS:0;jenkins-hbase4:36353] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-08-11 06:01:39,355 INFO [RS:0;jenkins-hbase4:36353] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,355 INFO [RS:0;jenkins-hbase4:36353] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,356 INFO [RS:0;jenkins-hbase4:36353] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,372 INFO [RS:0;jenkins-hbase4:36353] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-08-11 06:01:39,372 INFO [RS:0;jenkins-hbase4:36353] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36353,1691733699097-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,378 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-08-11 06:01:39,382 INFO [RS:0;jenkins-hbase4:36353] regionserver.Replication(203): jenkins-hbase4.apache.org,36353,1691733699097 started 2023-08-11 06:01:39,382 INFO [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36353,1691733699097, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36353, sessionid=0x101f29e2cd80001 2023-08-11 06:01:39,382 DEBUG [RS:0;jenkins-hbase4:36353] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-08-11 06:01:39,382 DEBUG [RS:0;jenkins-hbase4:36353] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36353,1691733699097 2023-08-11 06:01:39,382 DEBUG [RS:0;jenkins-hbase4:36353] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36353,1691733699097' 2023-08-11 06:01:39,382 DEBUG [RS:0;jenkins-hbase4:36353] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-08-11 06:01:39,383 DEBUG [RS:0;jenkins-hbase4:36353] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-08-11 06:01:39,383 DEBUG [RS:0;jenkins-hbase4:36353] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-08-11 06:01:39,383 DEBUG [RS:0;jenkins-hbase4:36353] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-08-11 06:01:39,383 DEBUG [RS:0;jenkins-hbase4:36353] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36353,1691733699097 2023-08-11 06:01:39,383 DEBUG [RS:0;jenkins-hbase4:36353] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36353,1691733699097' 2023-08-11 06:01:39,383 DEBUG [RS:0;jenkins-hbase4:36353] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-08-11 06:01:39,383 DEBUG [RS:0;jenkins-hbase4:36353] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-08-11 06:01:39,384 DEBUG [RS:0;jenkins-hbase4:36353] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-08-11 06:01:39,384 INFO [RS:0;jenkins-hbase4:36353] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-08-11 06:01:39,384 INFO [RS:0;jenkins-hbase4:36353] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-08-11 06:01:39,441 DEBUG [jenkins-hbase4:41211] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-08-11 06:01:39,442 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36353,1691733699097, state=OPENING 2023-08-11 06:01:39,445 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-08-11 06:01:39,446 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:39,447 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 06:01:39,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36353,1691733699097}] 2023-08-11 06:01:39,486 INFO [RS:0;jenkins-hbase4:36353] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36353%2C1691733699097, suffix=, logDir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/WALs/jenkins-hbase4.apache.org,36353,1691733699097, archiveDir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/oldWALs, maxLogs=32 2023-08-11 06:01:39,501 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38511,DS-c957b324-0fcd-4415-a588-ff301cc9bd8a,DISK] 2023-08-11 06:01:39,501 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35009,DS-ea967fbf-9436-44ab-ba5d-41323b2b5325,DISK] 2023-08-11 06:01:39,503 INFO [RS:0;jenkins-hbase4:36353] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/WALs/jenkins-hbase4.apache.org,36353,1691733699097/jenkins-hbase4.apache.org%2C36353%2C1691733699097.1691733699486 2023-08-11 06:01:39,503 DEBUG [RS:0;jenkins-hbase4:36353] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38511,DS-c957b324-0fcd-4415-a588-ff301cc9bd8a,DISK], DatanodeInfoWithStorage[127.0.0.1:35009,DS-ea967fbf-9436-44ab-ba5d-41323b2b5325,DISK]] 2023-08-11 06:01:39,600 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36353,1691733699097 2023-08-11 06:01:39,601 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-08-11 06:01:39,603 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-08-11 06:01:39,606 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-08-11 06:01:39,606 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 06:01:39,608 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36353%2C1691733699097.meta, suffix=.meta, logDir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/WALs/jenkins-hbase4.apache.org,36353,1691733699097, archiveDir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/oldWALs, maxLogs=32 2023-08-11 06:01:39,623 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35009,DS-ea967fbf-9436-44ab-ba5d-41323b2b5325,DISK] 2023-08-11 06:01:39,623 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38511,DS-c957b324-0fcd-4415-a588-ff301cc9bd8a,DISK] 2023-08-11 06:01:39,625 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/WALs/jenkins-hbase4.apache.org,36353,1691733699097/jenkins-hbase4.apache.org%2C36353%2C1691733699097.meta.1691733699608.meta 2023-08-11 06:01:39,625 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35009,DS-ea967fbf-9436-44ab-ba5d-41323b2b5325,DISK], DatanodeInfoWithStorage[127.0.0.1:38511,DS-c957b324-0fcd-4415-a588-ff301cc9bd8a,DISK]] 2023-08-11 06:01:39,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-08-11 06:01:39,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-08-11 06:01:39,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-08-11 06:01:39,626 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-08-11 06:01:39,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-08-11 06:01:39,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 06:01:39,627 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-08-11 06:01:39,627 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-08-11 06:01:39,628 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-08-11 06:01:39,629 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/info 2023-08-11 06:01:39,629 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/info 2023-08-11 06:01:39,629 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-08-11 06:01:39,630 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 06:01:39,630 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-08-11 06:01:39,631 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/rep_barrier 2023-08-11 06:01:39,631 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/rep_barrier 2023-08-11 06:01:39,631 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-08-11 06:01:39,632 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 06:01:39,632 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-08-11 06:01:39,632 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/table 2023-08-11 06:01:39,632 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/table 2023-08-11 06:01:39,633 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-08-11 06:01:39,633 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 06:01:39,634 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740 2023-08-11 06:01:39,635 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740 2023-08-11 06:01:39,637 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-08-11 06:01:39,638 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-08-11 06:01:39,639 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=882604, jitterRate=0.12229003012180328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-08-11 06:01:39,639 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-08-11 06:01:39,639 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1691733699600 2023-08-11 06:01:39,643 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-08-11 06:01:39,644 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-08-11 06:01:39,644 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36353,1691733699097, state=OPEN 2023-08-11 06:01:39,646 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-08-11 06:01:39,646 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-08-11 06:01:39,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-08-11 06:01:39,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36353,1691733699097 in 199 msec 2023-08-11 06:01:39,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-08-11 06:01:39,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 360 msec 2023-08-11 06:01:39,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-08-11 06:01:39,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1691733699651, completionTime=-1 2023-08-11 06:01:39,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-08-11 06:01:39,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-08-11 06:01:39,654 DEBUG [hconnection-0x47c6400f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 06:01:39,656 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 06:01:39,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-08-11 06:01:39,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1691733759657 2023-08-11 06:01:39,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1691733819657 2023-08-11 06:01:39,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 6 msec 2023-08-11 06:01:39,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41211,1691733699048-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41211,1691733699048-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41211,1691733699048-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41211, period=300000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-08-11 06:01:39,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-08-11 06:01:39,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-08-11 06:01:39,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-08-11 06:01:39,665 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-08-11 06:01:39,667 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-08-11 06:01:39,667 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-08-11 06:01:39,669 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/.tmp/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393 2023-08-11 06:01:39,669 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/.tmp/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393 empty. 2023-08-11 06:01:39,669 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/.tmp/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393 2023-08-11 06:01:39,669 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-08-11 06:01:39,680 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-08-11 06:01:39,681 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4f170b87fa6811ff4c40276cabd97393, NAME => 'hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/.tmp 2023-08-11 06:01:39,691 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 06:01:39,691 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 4f170b87fa6811ff4c40276cabd97393, disabling compactions & flushes 2023-08-11 06:01:39,691 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. 2023-08-11 06:01:39,692 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. 2023-08-11 06:01:39,692 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. after waiting 0 ms 2023-08-11 06:01:39,692 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. 2023-08-11 06:01:39,692 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. 2023-08-11 06:01:39,692 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 4f170b87fa6811ff4c40276cabd97393: 2023-08-11 06:01:39,694 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-08-11 06:01:39,695 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691733699695"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1691733699695"}]},"ts":"1691733699695"} 2023-08-11 06:01:39,696 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-08-11 06:01:39,697 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-08-11 06:01:39,697 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733699697"}]},"ts":"1691733699697"} 2023-08-11 06:01:39,699 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-08-11 06:01:39,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4f170b87fa6811ff4c40276cabd97393, ASSIGN}] 2023-08-11 06:01:39,706 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4f170b87fa6811ff4c40276cabd97393, ASSIGN 2023-08-11 06:01:39,707 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4f170b87fa6811ff4c40276cabd97393, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36353,1691733699097; forceNewPlan=false, retain=false 2023-08-11 06:01:39,858 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4f170b87fa6811ff4c40276cabd97393, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36353,1691733699097 2023-08-11 06:01:39,858 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691733699858"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1691733699858"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1691733699858"}]},"ts":"1691733699858"} 2023-08-11 06:01:39,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4f170b87fa6811ff4c40276cabd97393, server=jenkins-hbase4.apache.org,36353,1691733699097}] 2023-08-11 06:01:40,015 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. 2023-08-11 06:01:40,015 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4f170b87fa6811ff4c40276cabd97393, NAME => 'hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393.', STARTKEY => '', ENDKEY => ''} 2023-08-11 06:01:40,015 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4f170b87fa6811ff4c40276cabd97393 2023-08-11 06:01:40,015 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-08-11 06:01:40,015 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4f170b87fa6811ff4c40276cabd97393 2023-08-11 06:01:40,015 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4f170b87fa6811ff4c40276cabd97393 2023-08-11 06:01:40,017 INFO [StoreOpener-4f170b87fa6811ff4c40276cabd97393-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4f170b87fa6811ff4c40276cabd97393 2023-08-11 06:01:40,018 DEBUG [StoreOpener-4f170b87fa6811ff4c40276cabd97393-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393/info 2023-08-11 06:01:40,018 DEBUG [StoreOpener-4f170b87fa6811ff4c40276cabd97393-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393/info 2023-08-11 06:01:40,018 INFO [StoreOpener-4f170b87fa6811ff4c40276cabd97393-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f170b87fa6811ff4c40276cabd97393 columnFamilyName info 2023-08-11 06:01:40,019 INFO [StoreOpener-4f170b87fa6811ff4c40276cabd97393-1] regionserver.HStore(310): Store=4f170b87fa6811ff4c40276cabd97393/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-08-11 06:01:40,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393 2023-08-11 06:01:40,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393 2023-08-11 06:01:40,023 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4f170b87fa6811ff4c40276cabd97393 2023-08-11 06:01:40,025 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-08-11 06:01:40,025 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4f170b87fa6811ff4c40276cabd97393; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=705383, jitterRate=-0.1030593067407608}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-08-11 06:01:40,025 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4f170b87fa6811ff4c40276cabd97393: 2023-08-11 06:01:40,026 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393., pid=6, masterSystemTime=1691733700012 2023-08-11 06:01:40,027 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. 2023-08-11 06:01:40,027 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. 2023-08-11 06:01:40,028 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4f170b87fa6811ff4c40276cabd97393, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36353,1691733699097 2023-08-11 06:01:40,028 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1691733700028"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1691733700028"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1691733700028"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1691733700028"}]},"ts":"1691733700028"} 2023-08-11 06:01:40,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-08-11 06:01:40,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4f170b87fa6811ff4c40276cabd97393, server=jenkins-hbase4.apache.org,36353,1691733699097 in 169 msec 2023-08-11 06:01:40,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-08-11 06:01:40,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4f170b87fa6811ff4c40276cabd97393, ASSIGN in 327 msec 2023-08-11 06:01:40,033 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-08-11 06:01:40,033 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1691733700033"}]},"ts":"1691733700033"} 2023-08-11 06:01:40,035 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-08-11 06:01:40,038 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-08-11 06:01:40,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 373 msec 2023-08-11 06:01:40,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-08-11 06:01:40,068 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-08-11 06:01:40,068 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:40,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-08-11 06:01:40,078 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 06:01:40,081 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-08-11 06:01:40,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-08-11 06:01:40,090 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-08-11 06:01:40,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-08-11 06:01:40,097 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-08-11 06:01:40,100 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-08-11 06:01:40,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.972sec 2023-08-11 06:01:40,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-08-11 06:01:40,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-08-11 06:01:40,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-08-11 06:01:40,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41211,1691733699048-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-08-11 06:01:40,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41211,1691733699048-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-08-11 06:01:40,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-08-11 06:01:40,122 DEBUG [Listener at localhost/38347] zookeeper.ReadOnlyZKClient(139): Connect 0x39a6b0fd to 127.0.0.1:57159 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-08-11 06:01:40,127 DEBUG [Listener at localhost/38347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a5a24c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-08-11 06:01:40,129 DEBUG [hconnection-0xbf08510-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-08-11 06:01:40,130 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-08-11 06:01:40,132 INFO [Listener at localhost/38347] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41211,1691733699048 2023-08-11 06:01:40,132 INFO [Listener at localhost/38347] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-08-11 06:01:40,136 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-08-11 06:01:40,136 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:40,136 INFO [Listener at localhost/38347] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-08-11 06:01:40,136 INFO [Listener at localhost/38347] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-08-11 06:01:40,138 INFO [Listener at localhost/38347] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=test.com%2C8080%2C1, suffix=, logDir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/WALs/test.com,8080,1, archiveDir=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/oldWALs, maxLogs=32 2023-08-11 06:01:40,154 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38511,DS-c957b324-0fcd-4415-a588-ff301cc9bd8a,DISK] 2023-08-11 06:01:40,154 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35009,DS-ea967fbf-9436-44ab-ba5d-41323b2b5325,DISK] 2023-08-11 06:01:40,156 INFO [Listener at localhost/38347] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/WALs/test.com,8080,1/test.com%2C8080%2C1.1691733700139 2023-08-11 06:01:40,156 DEBUG [Listener at localhost/38347] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38511,DS-c957b324-0fcd-4415-a588-ff301cc9bd8a,DISK], DatanodeInfoWithStorage[127.0.0.1:35009,DS-ea967fbf-9436-44ab-ba5d-41323b2b5325,DISK]] 2023-08-11 06:01:40,170 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38511,DS-c957b324-0fcd-4415-a588-ff301cc9bd8a,DISK] 2023-08-11 06:01:40,170 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35009,DS-ea967fbf-9436-44ab-ba5d-41323b2b5325,DISK] 2023-08-11 06:01:40,172 INFO [Listener at localhost/38347] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/WALs/test.com,8080,1/test.com%2C8080%2C1.1691733700139 with entries=0, filesize=83 B; new WAL /user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/WALs/test.com,8080,1/test.com%2C8080%2C1.1691733700156 2023-08-11 06:01:40,172 DEBUG [Listener at localhost/38347] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38511,DS-c957b324-0fcd-4415-a588-ff301cc9bd8a,DISK], DatanodeInfoWithStorage[127.0.0.1:35009,DS-ea967fbf-9436-44ab-ba5d-41323b2b5325,DISK]] 2023-08-11 06:01:40,172 DEBUG [Listener at localhost/38347] wal.AbstractFSWAL(716): hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/WALs/test.com,8080,1/test.com%2C8080%2C1.1691733700139 is not closed yet, will try archiving it next time 2023-08-11 06:01:40,177 WARN [Close-WAL-Writer-1] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/WALs/test.com,8080,1/test.com%2C8080%2C1.1691733700156 not finished, retry = 0 2023-08-11 06:01:40,179 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/WALs/test.com,8080,1/test.com%2C8080%2C1.1691733700139 to hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/oldWALs/test.com%2C8080%2C1.1691733700139 2023-08-11 06:01:40,280 DEBUG [Listener at localhost/38347] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/oldWALs 2023-08-11 06:01:40,280 INFO [Listener at localhost/38347] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL test.com%2C8080%2C1:(num 1691733700156) 2023-08-11 06:01:40,280 INFO [Listener at localhost/38347] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-08-11 06:01:40,281 DEBUG [Listener at localhost/38347] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39a6b0fd to 127.0.0.1:57159 2023-08-11 06:01:40,281 DEBUG [Listener at localhost/38347] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 06:01:40,282 DEBUG [Listener at localhost/38347] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-08-11 06:01:40,282 DEBUG [Listener at localhost/38347] util.JVMClusterUtil(257): Found active master hash=1621278017, stopped=false 2023-08-11 06:01:40,282 INFO [Listener at localhost/38347] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41211,1691733699048 2023-08-11 06:01:40,284 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 06:01:40,284 INFO [Listener at localhost/38347] procedure2.ProcedureExecutor(629): Stopping 2023-08-11 06:01:40,284 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): regionserver:36353-0x101f29e2cd80001, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-08-11 06:01:40,284 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:40,285 DEBUG [Listener at localhost/38347] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69af507a to 127.0.0.1:57159 2023-08-11 06:01:40,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36353-0x101f29e2cd80001, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 06:01:40,285 DEBUG [Listener at localhost/38347] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 06:01:40,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-08-11 06:01:40,286 INFO [Listener at localhost/38347] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36353,1691733699097' ***** 2023-08-11 06:01:40,286 INFO [Listener at localhost/38347] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-08-11 06:01:40,286 INFO [RS:0;jenkins-hbase4:36353] regionserver.HeapMemoryManager(220): Stopping 2023-08-11 06:01:40,286 INFO [RS:0;jenkins-hbase4:36353] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-08-11 06:01:40,286 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-08-11 06:01:40,286 INFO [RS:0;jenkins-hbase4:36353] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-08-11 06:01:40,287 INFO [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(3305): Received CLOSE for 4f170b87fa6811ff4c40276cabd97393 2023-08-11 06:01:40,287 INFO [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36353,1691733699097 2023-08-11 06:01:40,287 DEBUG [RS:0;jenkins-hbase4:36353] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ced259e to 127.0.0.1:57159 2023-08-11 06:01:40,288 DEBUG [RS:0;jenkins-hbase4:36353] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 06:01:40,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4f170b87fa6811ff4c40276cabd97393, disabling compactions & flushes 2023-08-11 06:01:40,288 INFO [RS:0;jenkins-hbase4:36353] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-08-11 06:01:40,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. 2023-08-11 06:01:40,288 INFO [RS:0;jenkins-hbase4:36353] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-08-11 06:01:40,288 INFO [RS:0;jenkins-hbase4:36353] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-08-11 06:01:40,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. 2023-08-11 06:01:40,288 INFO [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-08-11 06:01:40,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. after waiting 0 ms 2023-08-11 06:01:40,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. 2023-08-11 06:01:40,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4f170b87fa6811ff4c40276cabd97393 1/1 column families, dataSize=78 B heapSize=488 B 2023-08-11 06:01:40,288 INFO [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-08-11 06:01:40,288 DEBUG [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(1478): Online Regions={4f170b87fa6811ff4c40276cabd97393=hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393., 1588230740=hbase:meta,,1.1588230740} 2023-08-11 06:01:40,289 DEBUG [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(1504): Waiting on 1588230740, 4f170b87fa6811ff4c40276cabd97393 2023-08-11 06:01:40,289 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-08-11 06:01:40,289 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-08-11 06:01:40,289 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-08-11 06:01:40,289 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-08-11 06:01:40,289 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-08-11 06:01:40,289 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=1.26 KB heapSize=2.89 KB 2023-08-11 06:01:40,310 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.17 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/.tmp/info/b85cc39432f441028377a9d0874fc7eb 2023-08-11 06:01:40,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393/.tmp/info/1bf8eaa0f70247ae989a8c8b9c14dbbf 2023-08-11 06:01:40,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393/.tmp/info/1bf8eaa0f70247ae989a8c8b9c14dbbf as hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393/info/1bf8eaa0f70247ae989a8c8b9c14dbbf 2023-08-11 06:01:40,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393/info/1bf8eaa0f70247ae989a8c8b9c14dbbf, entries=2, sequenceid=6, filesize=4.8 K 2023-08-11 06:01:40,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4f170b87fa6811ff4c40276cabd97393 in 40ms, sequenceid=6, compaction requested=false 2023-08-11 06:01:40,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-08-11 06:01:40,338 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=94 B at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/.tmp/table/7c0ef4fd2c2743f897bc0f838e8008a2 2023-08-11 06:01:40,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/namespace/4f170b87fa6811ff4c40276cabd97393/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-08-11 06:01:40,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. 2023-08-11 06:01:40,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4f170b87fa6811ff4c40276cabd97393: 2023-08-11 06:01:40,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1691733699664.4f170b87fa6811ff4c40276cabd97393. 2023-08-11 06:01:40,344 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/.tmp/info/b85cc39432f441028377a9d0874fc7eb as hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/info/b85cc39432f441028377a9d0874fc7eb 2023-08-11 06:01:40,350 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/info/b85cc39432f441028377a9d0874fc7eb, entries=10, sequenceid=9, filesize=5.9 K 2023-08-11 06:01:40,351 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/.tmp/table/7c0ef4fd2c2743f897bc0f838e8008a2 as hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/table/7c0ef4fd2c2743f897bc0f838e8008a2 2023-08-11 06:01:40,356 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-08-11 06:01:40,356 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-08-11 06:01:40,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/table/7c0ef4fd2c2743f897bc0f838e8008a2, entries=2, sequenceid=9, filesize=4.7 K 2023-08-11 06:01:40,357 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.26 KB/1290, heapSize ~2.61 KB/2672, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=9, compaction requested=false 2023-08-11 06:01:40,358 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-08-11 06:01:40,366 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/data/hbase/meta/1588230740/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-08-11 06:01:40,367 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-08-11 06:01:40,367 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-08-11 06:01:40,367 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-08-11 06:01:40,367 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-08-11 06:01:40,489 INFO [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36353,1691733699097; all regions closed. 2023-08-11 06:01:40,495 DEBUG [RS:0;jenkins-hbase4:36353] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/oldWALs 2023-08-11 06:01:40,496 INFO [RS:0;jenkins-hbase4:36353] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36353%2C1691733699097.meta:.meta(num 1691733699608) 2023-08-11 06:01:40,500 DEBUG [RS:0;jenkins-hbase4:36353] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/oldWALs 2023-08-11 06:01:40,500 INFO [RS:0;jenkins-hbase4:36353] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36353%2C1691733699097:(num 1691733699486) 2023-08-11 06:01:40,500 DEBUG [RS:0;jenkins-hbase4:36353] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 06:01:40,500 INFO [RS:0;jenkins-hbase4:36353] regionserver.LeaseManager(133): Closed leases 2023-08-11 06:01:40,500 INFO [RS:0;jenkins-hbase4:36353] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-08-11 06:01:40,500 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 06:01:40,501 INFO [RS:0;jenkins-hbase4:36353] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36353 2023-08-11 06:01:40,504 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): regionserver:36353-0x101f29e2cd80001, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36353,1691733699097 2023-08-11 06:01:40,504 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 06:01:40,504 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): regionserver:36353-0x101f29e2cd80001, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-08-11 06:01:40,505 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36353,1691733699097] 2023-08-11 06:01:40,505 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36353,1691733699097; numProcessing=1 2023-08-11 06:01:40,506 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36353,1691733699097 already deleted, retry=false 2023-08-11 06:01:40,506 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36353,1691733699097 expired; onlineServers=0 2023-08-11 06:01:40,506 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41211,1691733699048' ***** 2023-08-11 06:01:40,506 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-08-11 06:01:40,507 DEBUG [M:0;jenkins-hbase4:41211] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@649d358d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-08-11 06:01:40,507 INFO [M:0;jenkins-hbase4:41211] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41211,1691733699048 2023-08-11 06:01:40,507 INFO [M:0;jenkins-hbase4:41211] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41211,1691733699048; all regions closed. 2023-08-11 06:01:40,507 DEBUG [M:0;jenkins-hbase4:41211] ipc.AbstractRpcClient(494): Stopping rpc client 2023-08-11 06:01:40,507 DEBUG [M:0;jenkins-hbase4:41211] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-08-11 06:01:40,507 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-08-11 06:01:40,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691733699256] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1691733699256,5,FailOnTimeoutGroup] 2023-08-11 06:01:40,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691733699257] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1691733699257,5,FailOnTimeoutGroup] 2023-08-11 06:01:40,507 DEBUG [M:0;jenkins-hbase4:41211] cleaner.HFileCleaner(317): Stopping file delete threads 2023-08-11 06:01:40,508 INFO [M:0;jenkins-hbase4:41211] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-08-11 06:01:40,508 INFO [M:0;jenkins-hbase4:41211] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-08-11 06:01:40,508 INFO [M:0;jenkins-hbase4:41211] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-08-11 06:01:40,508 DEBUG [M:0;jenkins-hbase4:41211] master.HMaster(1512): Stopping service threads 2023-08-11 06:01:40,508 INFO [M:0;jenkins-hbase4:41211] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-08-11 06:01:40,508 ERROR [M:0;jenkins-hbase4:41211] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-7,5,PEWorkerGroup] 2023-08-11 06:01:40,509 INFO [M:0;jenkins-hbase4:41211] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-08-11 06:01:40,509 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-08-11 06:01:40,509 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-08-11 06:01:40,509 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-08-11 06:01:40,509 DEBUG [M:0;jenkins-hbase4:41211] zookeeper.ZKUtil(398): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-08-11 06:01:40,510 WARN [M:0;jenkins-hbase4:41211] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-08-11 06:01:40,510 INFO [M:0;jenkins-hbase4:41211] assignment.AssignmentManager(315): Stopping assignment manager 2023-08-11 06:01:40,510 INFO [M:0;jenkins-hbase4:41211] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-08-11 06:01:40,510 DEBUG [M:0;jenkins-hbase4:41211] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-08-11 06:01:40,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-08-11 06:01:40,510 INFO [M:0;jenkins-hbase4:41211] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 06:01:40,510 DEBUG [M:0;jenkins-hbase4:41211] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 06:01:40,510 DEBUG [M:0;jenkins-hbase4:41211] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-08-11 06:01:40,511 DEBUG [M:0;jenkins-hbase4:41211] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 06:01:40,511 INFO [M:0;jenkins-hbase4:41211] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=24.07 KB heapSize=29.55 KB 2023-08-11 06:01:40,521 INFO [M:0;jenkins-hbase4:41211] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24.07 KB at sequenceid=66 (bloomFilter=true), to=hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/614e5a09abeb40f29378a6b0fac6cff1 2023-08-11 06:01:40,526 DEBUG [M:0;jenkins-hbase4:41211] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/614e5a09abeb40f29378a6b0fac6cff1 as hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/614e5a09abeb40f29378a6b0fac6cff1 2023-08-11 06:01:40,530 INFO [M:0;jenkins-hbase4:41211] regionserver.HStore(1080): Added hdfs://localhost:40121/user/jenkins/test-data/d002c03e-f0db-6c05-98db-523211c541f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/614e5a09abeb40f29378a6b0fac6cff1, entries=8, sequenceid=66, filesize=6.3 K 2023-08-11 06:01:40,531 INFO [M:0;jenkins-hbase4:41211] regionserver.HRegion(2948): Finished flush of dataSize ~24.07 KB/24646, heapSize ~29.54 KB/30248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=66, compaction requested=false 2023-08-11 06:01:40,532 INFO [M:0;jenkins-hbase4:41211] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-08-11 06:01:40,532 DEBUG [M:0;jenkins-hbase4:41211] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-08-11 06:01:40,535 INFO [M:0;jenkins-hbase4:41211] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-08-11 06:01:40,535 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-08-11 06:01:40,536 INFO [M:0;jenkins-hbase4:41211] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41211 2023-08-11 06:01:40,538 DEBUG [M:0;jenkins-hbase4:41211] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41211,1691733699048 already deleted, retry=false 2023-08-11 06:01:40,685 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 06:01:40,685 INFO [M:0;jenkins-hbase4:41211] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41211,1691733699048; zookeeper connection closed. 2023-08-11 06:01:40,685 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): master:41211-0x101f29e2cd80000, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 06:01:40,785 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): regionserver:36353-0x101f29e2cd80001, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 06:01:40,785 DEBUG [Listener at localhost/38347-EventThread] zookeeper.ZKWatcher(600): regionserver:36353-0x101f29e2cd80001, quorum=127.0.0.1:57159, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-08-11 06:01:40,785 INFO [RS:0;jenkins-hbase4:36353] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36353,1691733699097; zookeeper connection closed. 2023-08-11 06:01:40,787 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@403c279f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@403c279f 2023-08-11 06:01:40,787 INFO [Listener at localhost/38347] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-08-11 06:01:40,787 WARN [Listener at localhost/38347] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 06:01:40,791 INFO [Listener at localhost/38347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 06:01:40,894 WARN [BP-457018865-172.31.14.131-1691733698506 heartbeating to localhost/127.0.0.1:40121] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 06:01:40,894 WARN [BP-457018865-172.31.14.131-1691733698506 heartbeating to localhost/127.0.0.1:40121] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-457018865-172.31.14.131-1691733698506 (Datanode Uuid f420e3c3-d263-4415-9254-15350bb08996) service to localhost/127.0.0.1:40121 2023-08-11 06:01:40,895 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/cluster_8a1a2fb7-458f-650a-32ca-643a5274df35/dfs/data/data3/current/BP-457018865-172.31.14.131-1691733698506] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 06:01:40,895 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/cluster_8a1a2fb7-458f-650a-32ca-643a5274df35/dfs/data/data4/current/BP-457018865-172.31.14.131-1691733698506] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 06:01:40,896 WARN [Listener at localhost/38347] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-08-11 06:01:40,899 INFO [Listener at localhost/38347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 06:01:41,001 WARN [BP-457018865-172.31.14.131-1691733698506 heartbeating to localhost/127.0.0.1:40121] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-08-11 06:01:41,002 WARN [BP-457018865-172.31.14.131-1691733698506 heartbeating to localhost/127.0.0.1:40121] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-457018865-172.31.14.131-1691733698506 (Datanode Uuid 09a94acd-7f56-402f-9024-5dad8f512198) service to localhost/127.0.0.1:40121 2023-08-11 06:01:41,002 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/cluster_8a1a2fb7-458f-650a-32ca-643a5274df35/dfs/data/data1/current/BP-457018865-172.31.14.131-1691733698506] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 06:01:41,003 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/664c4d17-802d-ea4e-aaf7-d1b47d9adac6/cluster_8a1a2fb7-458f-650a-32ca-643a5274df35/dfs/data/data2/current/BP-457018865-172.31.14.131-1691733698506] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-08-11 06:01:41,015 INFO [Listener at localhost/38347] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-08-11 06:01:41,127 INFO [Listener at localhost/38347] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-08-11 06:01:41,138 INFO [Listener at localhost/38347] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-08-11 06:01:41,149 INFO [Listener at localhost/38347] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=100 (was 77) - Thread LEAK? -, OpenFileDescriptor=504 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=166 (was 166), ProcessCount=171 (was 171), AvailableMemoryMB=2817 (was 2826)