2023-07-11 21:22:05,835 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc 2023-07-11 21:22:05,850 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling timeout: 13 mins 2023-07-11 21:22:05,887 INFO [Time-limited test] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=574, ProcessCount=175, AvailableMemoryMB=4099 2023-07-11 21:22:05,896 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 21:22:05,896 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556, deleteOnExit=true 2023-07-11 21:22:05,897 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 21:22:05,897 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/test.cache.data in system properties and HBase conf 2023-07-11 21:22:05,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 21:22:05,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/hadoop.log.dir in system properties and HBase conf 2023-07-11 21:22:05,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 21:22:05,899 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 21:22:05,899 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 21:22:06,036 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-11 21:22:06,461 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 21:22:06,464 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:22:06,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:22:06,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 21:22:06,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:22:06,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 21:22:06,466 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 21:22:06,466 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:22:06,466 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:22:06,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 21:22:06,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/nfs.dump.dir in system properties and HBase conf 2023-07-11 21:22:06,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/java.io.tmpdir in system properties and HBase conf 2023-07-11 21:22:06,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:22:06,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 21:22:06,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 21:22:07,088 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 21:22:07,092 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 21:22:07,418 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-11 21:22:07,597 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-11 21:22:07,633 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:22:07,684 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:22:07,765 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/java.io.tmpdir/Jetty_localhost_43023_hdfs____ptakho/webapp 2023-07-11 21:22:07,974 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43023 2023-07-11 21:22:07,989 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 21:22:07,989 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 21:22:08,818 WARN [Listener at localhost/33063] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:22:09,001 WARN [Listener at localhost/33063] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:22:09,025 WARN [Listener at localhost/33063] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:22:09,032 INFO [Listener at localhost/33063] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:22:09,052 INFO [Listener at localhost/33063] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/java.io.tmpdir/Jetty_localhost_34913_datanode____ge7fup/webapp 2023-07-11 21:22:09,190 INFO [Listener at localhost/33063] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34913 2023-07-11 21:22:09,675 WARN [Listener at localhost/40701] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:22:09,718 WARN [Listener at localhost/40701] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:22:09,722 WARN [Listener at localhost/40701] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:22:09,728 INFO [Listener at localhost/40701] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:22:09,735 INFO [Listener at localhost/40701] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/java.io.tmpdir/Jetty_localhost_34871_datanode____m15gmw/webapp 2023-07-11 21:22:09,844 INFO [Listener at localhost/40701] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34871 2023-07-11 21:22:09,855 WARN [Listener at localhost/38687] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:22:10,295 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4fd914eda07e76ce: Processing first storage report for DS-9d6b275c-cb41-4f88-b8b1-5f62c7217982 from datanode 543707f2-3b69-4998-b776-c114e1ec8a59 2023-07-11 21:22:10,297 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4fd914eda07e76ce: from storage DS-9d6b275c-cb41-4f88-b8b1-5f62c7217982 node DatanodeRegistration(127.0.0.1:42283, datanodeUuid=543707f2-3b69-4998-b776-c114e1ec8a59, infoPort=40521, infoSecurePort=0, ipcPort=38687, storageInfo=lv=-57;cid=testClusterID;nsid=1335081474;c=1689110527177), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-11 21:22:10,297 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4f142a7e34688b5c: Processing first storage report for DS-a877444b-e33c-4996-b833-4de1ba344776 from datanode 54088582-de4b-4ad0-9d2a-9aae193072fe 2023-07-11 21:22:10,297 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4f142a7e34688b5c: from storage DS-a877444b-e33c-4996-b833-4de1ba344776 node DatanodeRegistration(127.0.0.1:43477, datanodeUuid=54088582-de4b-4ad0-9d2a-9aae193072fe, infoPort=38187, infoSecurePort=0, ipcPort=40701, storageInfo=lv=-57;cid=testClusterID;nsid=1335081474;c=1689110527177), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:22:10,297 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4fd914eda07e76ce: Processing first storage report for DS-6ffb5437-3008-441d-8e98-a001f23a27b4 from datanode 543707f2-3b69-4998-b776-c114e1ec8a59 2023-07-11 21:22:10,298 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4fd914eda07e76ce: from storage DS-6ffb5437-3008-441d-8e98-a001f23a27b4 node DatanodeRegistration(127.0.0.1:42283, datanodeUuid=543707f2-3b69-4998-b776-c114e1ec8a59, infoPort=40521, infoSecurePort=0, ipcPort=38687, storageInfo=lv=-57;cid=testClusterID;nsid=1335081474;c=1689110527177), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:22:10,298 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4f142a7e34688b5c: Processing first storage report for DS-141a2654-23bb-4821-93ff-21f3039ae416 from datanode 54088582-de4b-4ad0-9d2a-9aae193072fe 2023-07-11 21:22:10,298 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4f142a7e34688b5c: from storage DS-141a2654-23bb-4821-93ff-21f3039ae416 node DatanodeRegistration(127.0.0.1:43477, datanodeUuid=54088582-de4b-4ad0-9d2a-9aae193072fe, infoPort=38187, infoSecurePort=0, ipcPort=40701, storageInfo=lv=-57;cid=testClusterID;nsid=1335081474;c=1689110527177), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:22:10,414 DEBUG [Listener at localhost/38687] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc 2023-07-11 21:22:10,537 INFO [Listener at localhost/38687] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/zookeeper_0, clientPort=61507, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 21:22:10,560 INFO [Listener at localhost/38687] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61507 2023-07-11 21:22:10,574 INFO [Listener at localhost/38687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:10,577 INFO [Listener at localhost/38687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:10,984 INFO [Listener at localhost/38687] util.FSUtils(471): Created version file at hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1 with version=8 2023-07-11 21:22:10,984 INFO [Listener at localhost/38687] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/hbase-staging 2023-07-11 21:22:11,426 INFO [Listener at localhost/38687] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-11 21:22:12,054 INFO [Listener at localhost/38687] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 21:22:12,086 INFO [Listener at localhost/38687] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:22:12,087 INFO [Listener at localhost/38687] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:22:12,087 INFO [Listener at localhost/38687] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:22:12,088 INFO [Listener at localhost/38687] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:22:12,088 INFO [Listener at localhost/38687] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:22:12,268 INFO [Listener at localhost/38687] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:22:12,367 DEBUG [Listener at localhost/38687] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 21:22:12,463 INFO [Listener at localhost/38687] ipc.NettyRpcServer(120): Bind to /172.31.10.131:38421 2023-07-11 21:22:12,474 INFO [Listener at localhost/38687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:12,476 INFO [Listener at localhost/38687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:12,501 INFO [Listener at localhost/38687] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38421 connecting to ZooKeeper ensemble=127.0.0.1:61507 2023-07-11 21:22:12,546 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:384210x0, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:22:12,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38421-0x101c1e014140000 connected 2023-07-11 21:22:12,574 DEBUG [Listener at localhost/38687] zookeeper.ZKUtil(164): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:22:12,575 DEBUG [Listener at localhost/38687] zookeeper.ZKUtil(164): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:22:12,579 DEBUG [Listener at localhost/38687] zookeeper.ZKUtil(164): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:22:12,586 DEBUG [Listener at localhost/38687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38421 2023-07-11 21:22:12,587 DEBUG [Listener at localhost/38687] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38421 2023-07-11 21:22:12,588 DEBUG [Listener at localhost/38687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38421 2023-07-11 21:22:12,588 DEBUG [Listener at localhost/38687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38421 2023-07-11 21:22:12,588 DEBUG [Listener at localhost/38687] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38421 2023-07-11 21:22:12,594 INFO [Listener at localhost/38687] master.HMaster(444): hbase.rootdir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1, hbase.cluster.distributed=false 2023-07-11 21:22:12,663 INFO [Listener at localhost/38687] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 21:22:12,664 INFO [Listener at localhost/38687] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:22:12,664 INFO [Listener at localhost/38687] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:22:12,664 INFO [Listener at localhost/38687] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:22:12,664 INFO [Listener at localhost/38687] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:22:12,664 INFO [Listener at localhost/38687] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:22:12,670 INFO [Listener at localhost/38687] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:22:12,673 INFO [Listener at localhost/38687] ipc.NettyRpcServer(120): Bind to /172.31.10.131:44595 2023-07-11 21:22:12,675 INFO [Listener at localhost/38687] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 21:22:12,681 DEBUG [Listener at localhost/38687] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 21:22:12,682 INFO [Listener at localhost/38687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:12,684 INFO [Listener at localhost/38687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:12,686 INFO [Listener at localhost/38687] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44595 connecting to ZooKeeper ensemble=127.0.0.1:61507 2023-07-11 21:22:12,689 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): regionserver:445950x0, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:22:12,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44595-0x101c1e014140001 connected 2023-07-11 21:22:12,690 DEBUG [Listener at localhost/38687] zookeeper.ZKUtil(164): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:22:12,692 DEBUG [Listener at localhost/38687] zookeeper.ZKUtil(164): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:22:12,693 DEBUG [Listener at localhost/38687] zookeeper.ZKUtil(164): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:22:12,693 DEBUG [Listener at localhost/38687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44595 2023-07-11 21:22:12,694 DEBUG [Listener at localhost/38687] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44595 2023-07-11 21:22:12,694 DEBUG [Listener at localhost/38687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44595 2023-07-11 21:22:12,695 DEBUG [Listener at localhost/38687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44595 2023-07-11 21:22:12,695 DEBUG [Listener at localhost/38687] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44595 2023-07-11 21:22:12,697 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,38421,1689110531204 2023-07-11 21:22:12,706 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 21:22:12,708 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,38421,1689110531204 2023-07-11 21:22:12,725 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:22:12,725 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:22:12,726 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:12,727 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 21:22:12,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 21:22:12,728 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,38421,1689110531204 from backup master directory 2023-07-11 21:22:12,732 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,38421,1689110531204 2023-07-11 21:22:12,732 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 21:22:12,733 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:22:12,733 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,38421,1689110531204 2023-07-11 21:22:12,735 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-11 21:22:12,737 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-11 21:22:12,831 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/hbase.id with ID: 187f7e4b-c6ec-45cd-907d-b78f744da610 2023-07-11 21:22:12,877 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:12,892 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:12,960 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x56d177dd to 127.0.0.1:61507 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:22:13,006 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d75bd7f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:22:13,033 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:22:13,036 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 21:22:13,050 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:22:13,095 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/data/master/store-tmp 2023-07-11 21:22:13,156 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:13,157 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 21:22:13,157 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:22:13,157 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:22:13,157 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 21:22:13,157 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:22:13,157 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:22:13,157 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:22:13,159 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/WALs/jenkins-hbase5.apache.org,38421,1689110531204 2023-07-11 21:22:13,189 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C38421%2C1689110531204, suffix=, logDir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/WALs/jenkins-hbase5.apache.org,38421,1689110531204, archiveDir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/oldWALs, maxLogs=10 2023-07-11 21:22:13,239 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-11 21:22:13,239 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-11 21:22:13,241 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:53) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:190) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:719) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:128) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:881) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:574) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:515) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:160) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:295) at org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:200) at org.apache.hadoop.hbase.master.region.MasterRegion.bootstrap(MasterRegion.java:220) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:348) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:13,278 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:417) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:13,280 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43477,DS-a877444b-e33c-4996-b833-4de1ba344776,DISK] 2023-07-11 21:22:13,280 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42283,DS-9d6b275c-cb41-4f88-b8b1-5f62c7217982,DISK] 2023-07-11 21:22:13,288 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:13,366 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/WALs/jenkins-hbase5.apache.org,38421,1689110531204/jenkins-hbase5.apache.org%2C38421%2C1689110531204.1689110533204 2023-07-11 21:22:13,367 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42283,DS-9d6b275c-cb41-4f88-b8b1-5f62c7217982,DISK], DatanodeInfoWithStorage[127.0.0.1:43477,DS-a877444b-e33c-4996-b833-4de1ba344776,DISK]] 2023-07-11 21:22:13,368 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:22:13,368 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:13,373 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:22:13,374 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:22:13,479 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:22:13,492 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 21:22:13,524 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 21:22:13,538 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:13,545 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:22:13,548 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:22:13,581 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:22:13,586 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:22:13,587 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=691863, jitterRate=-0.12025117874145508}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:22:13,587 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:22:13,588 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 21:22:13,607 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 21:22:13,607 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 21:22:13,609 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 21:22:13,611 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 21:22:13,643 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 31 msec 2023-07-11 21:22:13,643 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 21:22:13,671 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 21:22:13,678 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 21:22:13,711 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 21:22:13,716 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 21:22:13,719 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 21:22:13,725 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 21:22:13,730 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 21:22:13,735 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:13,737 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 21:22:13,737 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 21:22:13,757 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 21:22:13,764 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:22:13,764 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:22:13,764 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:13,766 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,38421,1689110531204, sessionid=0x101c1e014140000, setting cluster-up flag (Was=false) 2023-07-11 21:22:13,806 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:13,819 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 21:22:13,822 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,38421,1689110531204 2023-07-11 21:22:13,831 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:13,838 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 21:22:13,841 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,38421,1689110531204 2023-07-11 21:22:13,844 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/.hbase-snapshot/.tmp 2023-07-11 21:22:13,910 INFO [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(951): ClusterId : 187f7e4b-c6ec-45cd-907d-b78f744da610 2023-07-11 21:22:13,933 DEBUG [RS:0;jenkins-hbase5:44595] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 21:22:13,941 DEBUG [RS:0;jenkins-hbase5:44595] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 21:22:13,941 DEBUG [RS:0;jenkins-hbase5:44595] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 21:22:13,950 DEBUG [RS:0;jenkins-hbase5:44595] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 21:22:13,953 DEBUG [RS:0;jenkins-hbase5:44595] zookeeper.ReadOnlyZKClient(139): Connect 0x37687ebc to 127.0.0.1:61507 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:22:13,993 DEBUG [RS:0;jenkins-hbase5:44595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39af8621, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:22:13,994 DEBUG [RS:0;jenkins-hbase5:44595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d9015cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 21:22:14,030 DEBUG [RS:0;jenkins-hbase5:44595] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:44595 2023-07-11 21:22:14,036 INFO [RS:0;jenkins-hbase5:44595] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 21:22:14,036 INFO [RS:0;jenkins-hbase5:44595] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 21:22:14,036 DEBUG [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 21:22:14,040 INFO [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,38421,1689110531204 with isa=jenkins-hbase5.apache.org/172.31.10.131:44595, startcode=1689110532662 2023-07-11 21:22:14,063 DEBUG [RS:0;jenkins-hbase5:44595] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 21:22:14,089 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 21:22:14,107 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:22:14,107 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:22:14,107 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:22:14,107 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:22:14,107 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-07-11 21:22:14,108 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:14,108 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:22:14,108 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:14,132 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689110564132 2023-07-11 21:22:14,135 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 21:22:14,137 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 21:22:14,137 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 21:22:14,139 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:59979, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 21:22:14,144 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:22:14,149 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38421] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:22:14,150 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 21:22:14,165 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 21:22:14,166 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 21:22:14,166 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 21:22:14,167 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 21:22:14,176 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:14,185 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 21:22:14,187 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 21:22:14,188 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 21:22:14,195 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 21:22:14,196 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 21:22:14,198 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689110534198,5,FailOnTimeoutGroup] 2023-07-11 21:22:14,200 DEBUG [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 21:22:14,200 WARN [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 21:22:14,203 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689110534198,5,FailOnTimeoutGroup] 2023-07-11 21:22:14,203 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:14,204 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 21:22:14,206 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:14,206 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:14,244 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 21:22:14,246 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 21:22:14,246 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1 2023-07-11 21:22:14,301 INFO [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,38421,1689110531204 with isa=jenkins-hbase5.apache.org/172.31.10.131:44595, startcode=1689110532662 2023-07-11 21:22:14,312 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38421] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:14,313 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:14,318 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 21:22:14,321 DEBUG [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1 2023-07-11 21:22:14,321 DEBUG [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33063 2023-07-11 21:22:14,321 DEBUG [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 21:22:14,323 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/info 2023-07-11 21:22:14,325 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 21:22:14,327 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:14,328 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 21:22:14,332 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:22:14,332 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 21:22:14,333 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:14,334 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 21:22:14,336 DEBUG [RS:0;jenkins-hbase5:44595] zookeeper.ZKUtil(162): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:14,337 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:22:14,337 WARN [RS:0;jenkins-hbase5:44595] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:22:14,338 INFO [RS:0;jenkins-hbase5:44595] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:22:14,338 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/table 2023-07-11 21:22:14,338 DEBUG [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:14,339 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 21:22:14,340 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,44595,1689110532662] 2023-07-11 21:22:14,342 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:14,346 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740 2023-07-11 21:22:14,347 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740 2023-07-11 21:22:14,350 DEBUG [RS:0;jenkins-hbase5:44595] zookeeper.ZKUtil(162): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:14,352 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-11 21:22:14,355 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 21:22:14,365 DEBUG [RS:0;jenkins-hbase5:44595] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 21:22:14,367 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:22:14,371 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=718687, jitterRate=-0.08614332973957062}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-11 21:22:14,371 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 21:22:14,372 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 21:22:14,372 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 21:22:14,372 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 21:22:14,372 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 21:22:14,372 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 21:22:14,378 INFO [RS:0;jenkins-hbase5:44595] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 21:22:14,380 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 21:22:14,380 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 21:22:14,388 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 21:22:14,388 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 21:22:14,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 21:22:14,412 INFO [RS:0;jenkins-hbase5:44595] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 21:22:14,414 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 21:22:14,417 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 21:22:14,418 INFO [RS:0;jenkins-hbase5:44595] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 21:22:14,418 INFO [RS:0;jenkins-hbase5:44595] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:14,420 INFO [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 21:22:14,428 INFO [RS:0;jenkins-hbase5:44595] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:14,428 DEBUG [RS:0;jenkins-hbase5:44595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:14,429 DEBUG [RS:0;jenkins-hbase5:44595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:14,429 DEBUG [RS:0;jenkins-hbase5:44595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:14,429 DEBUG [RS:0;jenkins-hbase5:44595] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:14,429 DEBUG [RS:0;jenkins-hbase5:44595] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:14,429 DEBUG [RS:0;jenkins-hbase5:44595] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:22:14,429 DEBUG [RS:0;jenkins-hbase5:44595] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:14,429 DEBUG [RS:0;jenkins-hbase5:44595] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:14,429 DEBUG [RS:0;jenkins-hbase5:44595] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:14,429 DEBUG [RS:0;jenkins-hbase5:44595] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:14,430 INFO [RS:0;jenkins-hbase5:44595] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:14,431 INFO [RS:0;jenkins-hbase5:44595] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:14,431 INFO [RS:0;jenkins-hbase5:44595] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:14,448 INFO [RS:0;jenkins-hbase5:44595] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 21:22:14,450 INFO [RS:0;jenkins-hbase5:44595] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,44595,1689110532662-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:14,469 INFO [RS:0;jenkins-hbase5:44595] regionserver.Replication(203): jenkins-hbase5.apache.org,44595,1689110532662 started 2023-07-11 21:22:14,469 INFO [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,44595,1689110532662, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:44595, sessionid=0x101c1e014140001 2023-07-11 21:22:14,469 DEBUG [RS:0;jenkins-hbase5:44595] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 21:22:14,470 DEBUG [RS:0;jenkins-hbase5:44595] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:14,470 DEBUG [RS:0;jenkins-hbase5:44595] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,44595,1689110532662' 2023-07-11 21:22:14,470 DEBUG [RS:0;jenkins-hbase5:44595] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:22:14,470 DEBUG [RS:0;jenkins-hbase5:44595] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:22:14,471 DEBUG [RS:0;jenkins-hbase5:44595] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 21:22:14,471 DEBUG [RS:0;jenkins-hbase5:44595] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 21:22:14,471 DEBUG [RS:0;jenkins-hbase5:44595] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:14,471 DEBUG [RS:0;jenkins-hbase5:44595] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,44595,1689110532662' 2023-07-11 21:22:14,471 DEBUG [RS:0;jenkins-hbase5:44595] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:22:14,472 DEBUG [RS:0;jenkins-hbase5:44595] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:22:14,473 DEBUG [RS:0;jenkins-hbase5:44595] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 21:22:14,473 INFO [RS:0;jenkins-hbase5:44595] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 21:22:14,473 INFO [RS:0;jenkins-hbase5:44595] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 21:22:14,569 DEBUG [jenkins-hbase5:38421] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-11 21:22:14,573 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,44595,1689110532662, state=OPENING 2023-07-11 21:22:14,582 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 21:22:14,584 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:14,585 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 21:22:14,588 INFO [RS:0;jenkins-hbase5:44595] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C44595%2C1689110532662, suffix=, logDir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662, archiveDir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/oldWALs, maxLogs=32 2023-07-11 21:22:14,590 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,44595,1689110532662}] 2023-07-11 21:22:14,618 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42283,DS-9d6b275c-cb41-4f88-b8b1-5f62c7217982,DISK] 2023-07-11 21:22:14,618 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43477,DS-a877444b-e33c-4996-b833-4de1ba344776,DISK] 2023-07-11 21:22:14,633 INFO [RS:0;jenkins-hbase5:44595] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.1689110534594 2023-07-11 21:22:14,633 DEBUG [RS:0;jenkins-hbase5:44595] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42283,DS-9d6b275c-cb41-4f88-b8b1-5f62c7217982,DISK], DatanodeInfoWithStorage[127.0.0.1:43477,DS-a877444b-e33c-4996-b833-4de1ba344776,DISK]] 2023-07-11 21:22:14,786 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:14,789 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:22:14,793 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:57804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:22:14,813 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 21:22:14,814 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:22:14,818 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta, suffix=.meta, logDir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662, archiveDir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/oldWALs, maxLogs=32 2023-07-11 21:22:14,844 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43477,DS-a877444b-e33c-4996-b833-4de1ba344776,DISK] 2023-07-11 21:22:14,844 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42283,DS-9d6b275c-cb41-4f88-b8b1-5f62c7217982,DISK] 2023-07-11 21:22:14,853 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta.1689110534821.meta 2023-07-11 21:22:14,859 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43477,DS-a877444b-e33c-4996-b833-4de1ba344776,DISK], DatanodeInfoWithStorage[127.0.0.1:42283,DS-9d6b275c-cb41-4f88-b8b1-5f62c7217982,DISK]] 2023-07-11 21:22:14,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:22:14,862 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 21:22:14,883 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 21:22:14,889 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 21:22:14,895 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 21:22:14,895 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:14,896 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 21:22:14,896 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 21:22:14,899 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 21:22:14,901 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/info 2023-07-11 21:22:14,901 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/info 2023-07-11 21:22:14,902 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 21:22:14,903 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:14,904 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 21:22:14,905 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:22:14,905 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:22:14,906 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 21:22:14,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:14,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 21:22:14,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/table 2023-07-11 21:22:14,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/table 2023-07-11 21:22:14,909 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 21:22:14,910 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:14,912 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740 2023-07-11 21:22:14,916 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740 2023-07-11 21:22:14,920 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-11 21:22:14,922 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 21:22:14,924 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=766387, jitterRate=-0.02548883855342865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-11 21:22:14,924 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 21:22:14,934 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689110534776 2023-07-11 21:22:14,952 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 21:22:14,953 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 21:22:14,954 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,44595,1689110532662, state=OPEN 2023-07-11 21:22:14,956 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 21:22:14,957 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 21:22:14,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 21:22:14,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,44595,1689110532662 in 367 msec 2023-07-11 21:22:14,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 21:22:14,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 568 msec 2023-07-11 21:22:14,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 976 msec 2023-07-11 21:22:14,977 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689110534977, completionTime=-1 2023-07-11 21:22:14,977 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-11 21:22:14,978 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 21:22:15,044 DEBUG [hconnection-0xa5bfd6c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:22:15,048 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:57818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:22:15,068 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-11 21:22:15,068 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689110595068 2023-07-11 21:22:15,068 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689110655068 2023-07-11 21:22:15,068 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 90 msec 2023-07-11 21:22:15,093 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,38421,1689110531204-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:15,093 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,38421,1689110531204-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:15,093 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,38421,1689110531204-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:15,095 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:38421, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:15,095 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:15,102 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 21:22:15,111 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 21:22:15,113 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:22:15,124 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 21:22:15,127 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:22:15,130 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:22:15,154 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/.tmp/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb 2023-07-11 21:22:15,156 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/.tmp/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb empty. 2023-07-11 21:22:15,157 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/.tmp/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb 2023-07-11 21:22:15,157 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 21:22:15,211 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 21:22:15,214 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => a8f9af9d260e940c5d482280ebbd11cb, NAME => 'hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/.tmp 2023-07-11 21:22:15,236 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:15,236 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing a8f9af9d260e940c5d482280ebbd11cb, disabling compactions & flushes 2023-07-11 21:22:15,236 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. 2023-07-11 21:22:15,236 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. 2023-07-11 21:22:15,236 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. after waiting 0 ms 2023-07-11 21:22:15,236 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. 2023-07-11 21:22:15,237 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. 2023-07-11 21:22:15,237 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for a8f9af9d260e940c5d482280ebbd11cb: 2023-07-11 21:22:15,242 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:22:15,259 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689110535245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689110535245"}]},"ts":"1689110535245"} 2023-07-11 21:22:15,291 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 21:22:15,293 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:22:15,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110535293"}]},"ts":"1689110535293"} 2023-07-11 21:22:15,305 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 21:22:15,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a8f9af9d260e940c5d482280ebbd11cb, ASSIGN}] 2023-07-11 21:22:15,320 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a8f9af9d260e940c5d482280ebbd11cb, ASSIGN 2023-07-11 21:22:15,323 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a8f9af9d260e940c5d482280ebbd11cb, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44595,1689110532662; forceNewPlan=false, retain=false 2023-07-11 21:22:15,475 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a8f9af9d260e940c5d482280ebbd11cb, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:15,475 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689110535474"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689110535474"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689110535474"}]},"ts":"1689110535474"} 2023-07-11 21:22:15,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a8f9af9d260e940c5d482280ebbd11cb, server=jenkins-hbase5.apache.org,44595,1689110532662}] 2023-07-11 21:22:15,652 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. 2023-07-11 21:22:15,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a8f9af9d260e940c5d482280ebbd11cb, NAME => 'hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:22:15,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a8f9af9d260e940c5d482280ebbd11cb 2023-07-11 21:22:15,654 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:15,655 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for a8f9af9d260e940c5d482280ebbd11cb 2023-07-11 21:22:15,655 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for a8f9af9d260e940c5d482280ebbd11cb 2023-07-11 21:22:15,657 INFO [StoreOpener-a8f9af9d260e940c5d482280ebbd11cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a8f9af9d260e940c5d482280ebbd11cb 2023-07-11 21:22:15,661 DEBUG [StoreOpener-a8f9af9d260e940c5d482280ebbd11cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb/info 2023-07-11 21:22:15,661 DEBUG [StoreOpener-a8f9af9d260e940c5d482280ebbd11cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb/info 2023-07-11 21:22:15,662 INFO [StoreOpener-a8f9af9d260e940c5d482280ebbd11cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8f9af9d260e940c5d482280ebbd11cb columnFamilyName info 2023-07-11 21:22:15,663 INFO [StoreOpener-a8f9af9d260e940c5d482280ebbd11cb-1] regionserver.HStore(310): Store=a8f9af9d260e940c5d482280ebbd11cb/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:15,665 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb 2023-07-11 21:22:15,666 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb 2023-07-11 21:22:15,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for a8f9af9d260e940c5d482280ebbd11cb 2023-07-11 21:22:15,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:22:15,682 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened a8f9af9d260e940c5d482280ebbd11cb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=848830, jitterRate=0.07934434711933136}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:22:15,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for a8f9af9d260e940c5d482280ebbd11cb: 2023-07-11 21:22:15,685 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb., pid=6, masterSystemTime=1689110535642 2023-07-11 21:22:15,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. 2023-07-11 21:22:15,691 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. 2023-07-11 21:22:15,693 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a8f9af9d260e940c5d482280ebbd11cb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:15,694 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689110535692"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689110535692"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689110535692"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689110535692"}]},"ts":"1689110535692"} 2023-07-11 21:22:15,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 21:22:15,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a8f9af9d260e940c5d482280ebbd11cb, server=jenkins-hbase5.apache.org,44595,1689110532662 in 213 msec 2023-07-11 21:22:15,710 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 21:22:15,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a8f9af9d260e940c5d482280ebbd11cb, ASSIGN in 389 msec 2023-07-11 21:22:15,713 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:22:15,714 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110535713"}]},"ts":"1689110535713"} 2023-07-11 21:22:15,719 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 21:22:15,731 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 21:22:15,732 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:22:15,732 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:22:15,733 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:15,736 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 618 msec 2023-07-11 21:22:15,796 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 21:22:15,821 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:22:15,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 54 msec 2023-07-11 21:22:15,844 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 21:22:15,863 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:22:15,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 27 msec 2023-07-11 21:22:15,899 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 21:22:15,902 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 21:22:15,902 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.169sec 2023-07-11 21:22:15,904 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 21:22:15,906 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 21:22:15,906 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 21:22:15,908 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,38421,1689110531204-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 21:22:15,908 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,38421,1689110531204-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 21:22:15,917 DEBUG [Listener at localhost/38687] zookeeper.ReadOnlyZKClient(139): Connect 0x334d6d12 to 127.0.0.1:61507 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:22:15,958 DEBUG [Listener at localhost/38687] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@157da849, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:22:15,960 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 21:22:16,012 DEBUG [hconnection-0x757051a2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:22:16,028 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:57830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:22:16,039 INFO [Listener at localhost/38687] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,38421,1689110531204 2023-07-11 21:22:16,040 INFO [Listener at localhost/38687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:16,049 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-11 21:22:16,049 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:16,050 INFO [Listener at localhost/38687] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-11 21:22:16,087 WARN [Listener at localhost/38687] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:22:16,090 WARN [Listener at localhost/38687] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:22:16,093 INFO [Listener at localhost/38687] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:22:16,100 INFO [Listener at localhost/38687] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/java.io.tmpdir/Jetty_localhost_41727_datanode____.dj1gu2/webapp 2023-07-11 21:22:16,232 INFO [Listener at localhost/38687] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41727 2023-07-11 21:22:16,245 WARN [Listener at localhost/40155] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:22:16,291 WARN [Listener at localhost/40155] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:22:16,298 WARN [Listener at localhost/40155] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:22:16,300 INFO [Listener at localhost/40155] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:22:16,316 INFO [Listener at localhost/40155] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/java.io.tmpdir/Jetty_localhost_45957_datanode____.mir1cv/webapp 2023-07-11 21:22:16,417 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb6b2190b3d937d9: Processing first storage report for DS-32ba4a85-f807-4c06-bb57-9a90f546316c from datanode e6a84791-268c-4782-be85-9b910ae66726 2023-07-11 21:22:16,418 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb6b2190b3d937d9: from storage DS-32ba4a85-f807-4c06-bb57-9a90f546316c node DatanodeRegistration(127.0.0.1:42335, datanodeUuid=e6a84791-268c-4782-be85-9b910ae66726, infoPort=44523, infoSecurePort=0, ipcPort=40155, storageInfo=lv=-57;cid=testClusterID;nsid=1335081474;c=1689110527177), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:22:16,418 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb6b2190b3d937d9: Processing first storage report for DS-463c7ab4-cc3e-4cdf-871e-5368c20a4b05 from datanode e6a84791-268c-4782-be85-9b910ae66726 2023-07-11 21:22:16,418 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb6b2190b3d937d9: from storage DS-463c7ab4-cc3e-4cdf-871e-5368c20a4b05 node DatanodeRegistration(127.0.0.1:42335, datanodeUuid=e6a84791-268c-4782-be85-9b910ae66726, infoPort=44523, infoSecurePort=0, ipcPort=40155, storageInfo=lv=-57;cid=testClusterID;nsid=1335081474;c=1689110527177), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:22:16,528 INFO [Listener at localhost/40155] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45957 2023-07-11 21:22:16,550 WARN [Listener at localhost/35931] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:22:16,586 WARN [Listener at localhost/35931] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:22:16,591 WARN [Listener at localhost/35931] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:22:16,593 INFO [Listener at localhost/35931] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:22:16,599 INFO [Listener at localhost/35931] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/java.io.tmpdir/Jetty_localhost_38985_datanode____.ekv02w/webapp 2023-07-11 21:22:16,706 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc2e036f70f6425ee: Processing first storage report for DS-a1b1c16e-950f-47f1-b844-11909bcc66df from datanode a9ec7d05-1d21-4153-9008-ba2aba2fded7 2023-07-11 21:22:16,706 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc2e036f70f6425ee: from storage DS-a1b1c16e-950f-47f1-b844-11909bcc66df node DatanodeRegistration(127.0.0.1:33795, datanodeUuid=a9ec7d05-1d21-4153-9008-ba2aba2fded7, infoPort=36287, infoSecurePort=0, ipcPort=35931, storageInfo=lv=-57;cid=testClusterID;nsid=1335081474;c=1689110527177), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:22:16,706 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc2e036f70f6425ee: Processing first storage report for DS-38a538fa-92dc-47dd-8b7b-46b0c597aab8 from datanode a9ec7d05-1d21-4153-9008-ba2aba2fded7 2023-07-11 21:22:16,706 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc2e036f70f6425ee: from storage DS-38a538fa-92dc-47dd-8b7b-46b0c597aab8 node DatanodeRegistration(127.0.0.1:33795, datanodeUuid=a9ec7d05-1d21-4153-9008-ba2aba2fded7, infoPort=36287, infoSecurePort=0, ipcPort=35931, storageInfo=lv=-57;cid=testClusterID;nsid=1335081474;c=1689110527177), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:22:16,722 INFO [Listener at localhost/35931] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38985 2023-07-11 21:22:16,730 WARN [Listener at localhost/46715] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:22:16,834 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x13c3b1f50bc7d3b0: Processing first storage report for DS-f779b254-bee4-42ae-ad6d-b70741c4a4c8 from datanode 2a7e8178-c9c4-4f77-9f20-abb2ba4df199 2023-07-11 21:22:16,834 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x13c3b1f50bc7d3b0: from storage DS-f779b254-bee4-42ae-ad6d-b70741c4a4c8 node DatanodeRegistration(127.0.0.1:42029, datanodeUuid=2a7e8178-c9c4-4f77-9f20-abb2ba4df199, infoPort=40309, infoSecurePort=0, ipcPort=46715, storageInfo=lv=-57;cid=testClusterID;nsid=1335081474;c=1689110527177), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:22:16,834 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x13c3b1f50bc7d3b0: Processing first storage report for DS-f495ccb1-bc5a-4e5d-ae8a-f139cdce2d66 from datanode 2a7e8178-c9c4-4f77-9f20-abb2ba4df199 2023-07-11 21:22:16,834 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x13c3b1f50bc7d3b0: from storage DS-f495ccb1-bc5a-4e5d-ae8a-f139cdce2d66 node DatanodeRegistration(127.0.0.1:42029, datanodeUuid=2a7e8178-c9c4-4f77-9f20-abb2ba4df199, infoPort=40309, infoSecurePort=0, ipcPort=46715, storageInfo=lv=-57;cid=testClusterID;nsid=1335081474;c=1689110527177), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:22:16,863 DEBUG [Listener at localhost/46715] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 21:22:16,867 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:60768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 21:22:16,878 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38421] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-07-11 21:22:16,878 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38421] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-07-11 21:22:16,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38421] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:22:16,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38421] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath 2023-07-11 21:22:16,889 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:22:16,892 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:22:16,895 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98 2023-07-11 21:22:16,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38421] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRollOnDatanodeDeath" procId is: 9 2023-07-11 21:22:16,897 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98 empty. 2023-07-11 21:22:16,899 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98 2023-07-11 21:22:16,899 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRollOnDatanodeDeath regions 2023-07-11 21:22:16,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38421] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:22:17,333 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/.tabledesc/.tableinfo.0000000001 2023-07-11 21:22:17,336 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6444b74f5e658a9e01123cd691275c98, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/.tmp 2023-07-11 21:22:17,377 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:17,377 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1604): Closing 6444b74f5e658a9e01123cd691275c98, disabling compactions & flushes 2023-07-11 21:22:17,377 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:17,377 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:17,377 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. after waiting 0 ms 2023-07-11 21:22:17,377 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:17,377 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:17,377 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1558): Region close journal for 6444b74f5e658a9e01123cd691275c98: 2023-07-11 21:22:17,382 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:22:17,385 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1689110537384"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689110537384"}]},"ts":"1689110537384"} 2023-07-11 21:22:17,388 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 21:22:17,389 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:22:17,390 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110537390"}]},"ts":"1689110537390"} 2023-07-11 21:22:17,392 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLING in hbase:meta 2023-07-11 21:22:17,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=6444b74f5e658a9e01123cd691275c98, ASSIGN}] 2023-07-11 21:22:17,400 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=6444b74f5e658a9e01123cd691275c98, ASSIGN 2023-07-11 21:22:17,402 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=6444b74f5e658a9e01123cd691275c98, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44595,1689110532662; forceNewPlan=false, retain=false 2023-07-11 21:22:17,553 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6444b74f5e658a9e01123cd691275c98, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:17,554 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1689110537553"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689110537553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689110537553"}]},"ts":"1689110537553"} 2023-07-11 21:22:17,557 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 6444b74f5e658a9e01123cd691275c98, server=jenkins-hbase5.apache.org,44595,1689110532662}] 2023-07-11 21:22:17,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:17,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6444b74f5e658a9e01123cd691275c98, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:22:17,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRollOnDatanodeDeath 6444b74f5e658a9e01123cd691275c98 2023-07-11 21:22:17,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:17,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 6444b74f5e658a9e01123cd691275c98 2023-07-11 21:22:17,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 6444b74f5e658a9e01123cd691275c98 2023-07-11 21:22:17,736 INFO [StoreOpener-6444b74f5e658a9e01123cd691275c98-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6444b74f5e658a9e01123cd691275c98 2023-07-11 21:22:17,738 DEBUG [StoreOpener-6444b74f5e658a9e01123cd691275c98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98/info 2023-07-11 21:22:17,738 DEBUG [StoreOpener-6444b74f5e658a9e01123cd691275c98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98/info 2023-07-11 21:22:17,739 INFO [StoreOpener-6444b74f5e658a9e01123cd691275c98-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6444b74f5e658a9e01123cd691275c98 columnFamilyName info 2023-07-11 21:22:17,740 INFO [StoreOpener-6444b74f5e658a9e01123cd691275c98-1] regionserver.HStore(310): Store=6444b74f5e658a9e01123cd691275c98/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:17,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98 2023-07-11 21:22:17,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98 2023-07-11 21:22:17,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 6444b74f5e658a9e01123cd691275c98 2023-07-11 21:22:17,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:22:17,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 6444b74f5e658a9e01123cd691275c98; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=799546, jitterRate=0.016675978899002075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:22:17,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 6444b74f5e658a9e01123cd691275c98: 2023-07-11 21:22:17,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98., pid=11, masterSystemTime=1689110537718 2023-07-11 21:22:17,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:17,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:17,765 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6444b74f5e658a9e01123cd691275c98, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:17,765 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1689110537765"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689110537765"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689110537765"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689110537765"}]},"ts":"1689110537765"} 2023-07-11 21:22:17,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-11 21:22:17,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 6444b74f5e658a9e01123cd691275c98, server=jenkins-hbase5.apache.org,44595,1689110532662 in 211 msec 2023-07-11 21:22:17,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-11 21:22:17,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=6444b74f5e658a9e01123cd691275c98, ASSIGN in 375 msec 2023-07-11 21:22:17,779 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:22:17,779 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110537779"}]},"ts":"1689110537779"} 2023-07-11 21:22:17,781 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLED in hbase:meta 2023-07-11 21:22:17,784 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:22:17,787 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath in 901 msec 2023-07-11 21:22:20,440 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-11 21:22:20,572 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 21:22:20,574 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 21:22:20,575 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRollOnDatanodeDeath' 2023-07-11 21:22:21,419 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:22:21,420 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 21:22:26,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38421] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:22:26,915 INFO [Listener at localhost/46715] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRollOnDatanodeDeath, procId: 9 completed 2023-07-11 21:22:26,915 DEBUG [Listener at localhost/46715] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestLogRolling-testLogRollOnDatanodeDeath get assigned. Timeout = 60000ms 2023-07-11 21:22:26,917 INFO [Listener at localhost/46715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:22:26,921 INFO [Listener at localhost/46715] hbase.HBaseTestingUtility(3484): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned to meta. Checking AM states. 2023-07-11 21:22:26,922 INFO [Listener at localhost/46715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:22:26,922 INFO [Listener at localhost/46715] hbase.HBaseTestingUtility(3504): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned. 2023-07-11 21:22:26,933 DEBUG [Listener at localhost/46715] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRollOnDatanodeDeath 2023-07-11 21:22:26,934 DEBUG [Listener at localhost/46715] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:26,934 WARN [Listener at localhost/46715] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:22:26,940 INFO [Listener at localhost/46715] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:22:26,946 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1432600026_17 at /127.0.0.1:40840 [Receiving block BP-199629002-172.31.10.131-1689110527177:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:43477:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:40840 dst: /127.0.0.1:43477 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:26,946 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1432600026_17 at /127.0.0.1:40826 [Receiving block BP-199629002-172.31.10.131-1689110527177:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:43477:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:40826 dst: /127.0.0.1:43477 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:26,946 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-602241466_17 at /127.0.0.1:40798 [Receiving block BP-199629002-172.31.10.131-1689110527177:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:43477:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:40798 dst: /127.0.0.1:43477 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:27,043 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-602241466_17 at /127.0.0.1:59378 [Receiving block BP-199629002-172.31.10.131-1689110527177:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:42283:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:59378 dst: /127.0.0.1:42283 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:27,045 WARN [BP-199629002-172.31.10.131-1689110527177 heartbeating to localhost/127.0.0.1:33063] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:22:27,044 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1432600026_17 at /127.0.0.1:59422 [Receiving block BP-199629002-172.31.10.131-1689110527177:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:42283:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:59422 dst: /127.0.0.1:42283 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:27,044 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1432600026_17 at /127.0.0.1:59408 [Receiving block BP-199629002-172.31.10.131-1689110527177:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:42283:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:59408 dst: /127.0.0.1:42283 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:27,045 WARN [BP-199629002-172.31.10.131-1689110527177 heartbeating to localhost/127.0.0.1:33063] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-199629002-172.31.10.131-1689110527177 (Datanode Uuid 543707f2-3b69-4998-b776-c114e1ec8a59) service to localhost/127.0.0.1:33063 2023-07-11 21:22:27,048 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/dfs/data/data3/current/BP-199629002-172.31.10.131-1689110527177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:22:27,048 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/dfs/data/data4/current/BP-199629002-172.31.10.131-1689110527177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:22:27,059 WARN [Listener at localhost/46715] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:22:27,063 WARN [Listener at localhost/46715] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:22:27,064 INFO [Listener at localhost/46715] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:22:27,068 INFO [Listener at localhost/46715] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/java.io.tmpdir/Jetty_localhost_44653_datanode____1kdwvv/webapp 2023-07-11 21:22:27,165 INFO [Listener at localhost/46715] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44653 2023-07-11 21:22:27,176 WARN [Listener at localhost/46483] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:22:27,181 WARN [AsyncFSWAL-0-hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1-prefix:jenkins-hbase5.apache.org,44595,1689110532662] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:27,183 DEBUG [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase5.apache.org%2C44595%2C1689110532662:(num 1689110534594) roll requested 2023-07-11 21:22:27,201 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42335,DS-32ba4a85-f807-4c06-bb57-9a90f546316c,DISK] 2023-07-11 21:22:27,201 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43477,DS-a877444b-e33c-4996-b833-4de1ba344776,DISK] 2023-07-11 21:22:27,206 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.1689110534594 with entries=6, filesize=3.19 KB; new WAL /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.1689110547183 2023-07-11 21:22:27,206 DEBUG [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43477,DS-a877444b-e33c-4996-b833-4de1ba344776,DISK], DatanodeInfoWithStorage[127.0.0.1:42335,DS-32ba4a85-f807-4c06-bb57-9a90f546316c,DISK]] 2023-07-11 21:22:27,207 DEBUG [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.1689110534594 is not closed yet, will try archiving it next time 2023-07-11 21:22:27,209 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 21:22:27,209 INFO [Listener at localhost/46483] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 21:22:27,210 DEBUG [Listener at localhost/46483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x334d6d12 to 127.0.0.1:61507 2023-07-11 21:22:27,210 DEBUG [Listener at localhost/46483] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:22:27,215 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:27,217 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:27,217 DEBUG [Listener at localhost/46483] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 21:22:27,217 DEBUG [Listener at localhost/46483] util.JVMClusterUtil(257): Found active master hash=1615941054, stopped=false 2023-07-11 21:22:27,217 INFO [Listener at localhost/46483] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,38421,1689110531204 2023-07-11 21:22:27,219 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.1689110534594 2023-07-11 21:22:27,219 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 21:22:27,219 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 21:22:27,219 INFO [Listener at localhost/46483] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 21:22:27,220 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:27,220 DEBUG [Listener at localhost/46483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56d177dd to 127.0.0.1:61507 2023-07-11 21:22:27,221 DEBUG [Listener at localhost/46483] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:22:27,221 INFO [Listener at localhost/46483] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,44595,1689110532662' ***** 2023-07-11 21:22:27,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:22:27,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:22:27,221 INFO [Listener at localhost/46483] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 21:22:27,221 INFO [RS:0;jenkins-hbase5:44595] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 21:22:27,222 INFO [RS:0;jenkins-hbase5:44595] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 21:22:27,222 INFO [RS:0;jenkins-hbase5:44595] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 21:22:27,222 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 21:22:27,223 INFO [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(3305): Received CLOSE for a8f9af9d260e940c5d482280ebbd11cb 2023-07-11 21:22:27,224 INFO [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(3305): Received CLOSE for 6444b74f5e658a9e01123cd691275c98 2023-07-11 21:22:27,224 INFO [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:27,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing a8f9af9d260e940c5d482280ebbd11cb, disabling compactions & flushes 2023-07-11 21:22:27,224 DEBUG [RS:0;jenkins-hbase5:44595] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37687ebc to 127.0.0.1:61507 2023-07-11 21:22:27,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. 2023-07-11 21:22:27,225 DEBUG [RS:0;jenkins-hbase5:44595] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:22:27,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. 2023-07-11 21:22:27,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. after waiting 0 ms 2023-07-11 21:22:27,225 INFO [RS:0;jenkins-hbase5:44595] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 21:22:27,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. 2023-07-11 21:22:27,225 INFO [RS:0;jenkins-hbase5:44595] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 21:22:27,225 INFO [RS:0;jenkins-hbase5:44595] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 21:22:27,225 INFO [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 21:22:27,225 WARN [IPC Server handler 2 on default port 33063] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.1689110534594 has not been closed. Lease recovery is in progress. RecoveryId = 1015 for block blk_1073741832_1008 2023-07-11 21:22:27,225 INFO [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-11 21:22:27,226 DEBUG [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1478): Online Regions={a8f9af9d260e940c5d482280ebbd11cb=hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb., 6444b74f5e658a9e01123cd691275c98=TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98., 1588230740=hbase:meta,,1.1588230740} 2023-07-11 21:22:27,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing a8f9af9d260e940c5d482280ebbd11cb 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 21:22:27,226 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 21:22:27,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 21:22:27,227 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 21:22:27,227 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 21:22:27,227 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 21:22:27,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.92 KB heapSize=5.45 KB 2023-07-11 21:22:27,228 DEBUG [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1504): Waiting on 1588230740, 6444b74f5e658a9e01123cd691275c98, a8f9af9d260e940c5d482280ebbd11cb 2023-07-11 21:22:27,229 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.1689110534594 after 10ms 2023-07-11 21:22:27,236 WARN [AsyncFSWAL-0-hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1-prefix:jenkins-hbase5.apache.org,44595,1689110532662.meta] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:27,240 DEBUG [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta:.meta(num 1689110534821) roll requested 2023-07-11 21:22:27,261 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42029,DS-f779b254-bee4-42ae-ad6d-b70741c4a4c8,DISK] 2023-07-11 21:22:27,262 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42335,DS-32ba4a85-f807-4c06-bb57-9a90f546316c,DISK] 2023-07-11 21:22:27,270 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta.1689110534821.meta with entries=12, filesize=3.87 KB; new WAL /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta.1689110547240.meta 2023-07-11 21:22:27,270 DEBUG [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42029,DS-f779b254-bee4-42ae-ad6d-b70741c4a4c8,DISK], DatanodeInfoWithStorage[127.0.0.1:42335,DS-32ba4a85-f807-4c06-bb57-9a90f546316c,DISK]] 2023-07-11 21:22:27,270 DEBUG [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta.1689110534821.meta is not closed yet, will try archiving it next time 2023-07-11 21:22:27,270 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:27,273 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:27,274 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta.1689110534821.meta 2023-07-11 21:22:27,275 WARN [IPC Server handler 1 on default port 33063] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta.1689110534821.meta has not been closed. Lease recovery is in progress. RecoveryId = 1017 for block blk_1073741833_1009 2023-07-11 21:22:27,275 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta.1689110534821.meta after 1ms 2023-07-11 21:22:27,305 WARN [Thread-336] hdfs.DataStreamer(1658): Abandoning BP-199629002-172.31.10.131-1689110527177:blk_1073741840_1018 2023-07-11 21:22:27,308 WARN [Thread-336] hdfs.DataStreamer(1663): Excluding datanode DatanodeInfoWithStorage[127.0.0.1:42283,DS-9d6b275c-cb41-4f88-b8b1-5f62c7217982,DISK] 2023-07-11 21:22:27,334 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d517722fe5896f3: Processing first storage report for DS-9d6b275c-cb41-4f88-b8b1-5f62c7217982 from datanode 543707f2-3b69-4998-b776-c114e1ec8a59 2023-07-11 21:22:27,337 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d517722fe5896f3: from storage DS-9d6b275c-cb41-4f88-b8b1-5f62c7217982 node DatanodeRegistration(127.0.0.1:36897, datanodeUuid=543707f2-3b69-4998-b776-c114e1ec8a59, infoPort=40165, infoSecurePort=0, ipcPort=46483, storageInfo=lv=-57;cid=testClusterID;nsid=1335081474;c=1689110527177), blocks: 6, hasStaleStorage: false, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-11 21:22:27,338 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d517722fe5896f3: Processing first storage report for DS-6ffb5437-3008-441d-8e98-a001f23a27b4 from datanode 543707f2-3b69-4998-b776-c114e1ec8a59 2023-07-11 21:22:27,338 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d517722fe5896f3: from storage DS-6ffb5437-3008-441d-8e98-a001f23a27b4 node DatanodeRegistration(127.0.0.1:36897, datanodeUuid=543707f2-3b69-4998-b776-c114e1ec8a59, infoPort=40165, infoSecurePort=0, ipcPort=46483, storageInfo=lv=-57;cid=testClusterID;nsid=1335081474;c=1689110527177), blocks: 5, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-11 21:22:27,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.69 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/.tmp/info/42a4c655aa9642109c6cc8620bac0ffb 2023-07-11 21:22:27,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb/.tmp/info/627337b0f27b4e7e9481146d464f4fd5 2023-07-11 21:22:27,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb/.tmp/info/627337b0f27b4e7e9481146d464f4fd5 as hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb/info/627337b0f27b4e7e9481146d464f4fd5 2023-07-11 21:22:27,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb/info/627337b0f27b4e7e9481146d464f4fd5, entries=2, sequenceid=6, filesize=4.8 K 2023-07-11 21:22:27,412 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=240 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/.tmp/table/2b1f99b961064061bc5387e97b257005 2023-07-11 21:22:27,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a8f9af9d260e940c5d482280ebbd11cb in 187ms, sequenceid=6, compaction requested=false 2023-07-11 21:22:27,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/namespace/a8f9af9d260e940c5d482280ebbd11cb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:22:27,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. 2023-07-11 21:22:27,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for a8f9af9d260e940c5d482280ebbd11cb: 2023-07-11 21:22:27,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689110535112.a8f9af9d260e940c5d482280ebbd11cb. 2023-07-11 21:22:27,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 6444b74f5e658a9e01123cd691275c98, disabling compactions & flushes 2023-07-11 21:22:27,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:27,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:27,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. after waiting 0 ms 2023-07-11 21:22:27,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:27,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 6444b74f5e658a9e01123cd691275c98 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-07-11 21:22:27,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/.tmp/info/42a4c655aa9642109c6cc8620bac0ffb as hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/info/42a4c655aa9642109c6cc8620bac0ffb 2023-07-11 21:22:27,428 DEBUG [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1504): Waiting on 1588230740, 6444b74f5e658a9e01123cd691275c98 2023-07-11 21:22:27,431 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 21:22:27,431 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 21:22:27,435 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/info/42a4c655aa9642109c6cc8620bac0ffb, entries=20, sequenceid=14, filesize=7.4 K 2023-07-11 21:22:27,442 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/.tmp/table/2b1f99b961064061bc5387e97b257005 as hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/table/2b1f99b961064061bc5387e97b257005 2023-07-11 21:22:27,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98/.tmp/info/d50f0ef4b4964a4eb5b9658ba6259452 2023-07-11 21:22:27,451 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/table/2b1f99b961064061bc5387e97b257005, entries=4, sequenceid=14, filesize=4.8 K 2023-07-11 21:22:27,453 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.92 KB/2994, heapSize ~5.16 KB/5288, currentSize=0 B/0 for 1588230740 in 226ms, sequenceid=14, compaction requested=false 2023-07-11 21:22:27,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98/.tmp/info/d50f0ef4b4964a4eb5b9658ba6259452 as hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98/info/d50f0ef4b4964a4eb5b9658ba6259452 2023-07-11 21:22:27,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98/info/d50f0ef4b4964a4eb5b9658ba6259452, entries=2, sequenceid=6, filesize=6.8 K 2023-07-11 21:22:27,476 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-07-11 21:22:27,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for 6444b74f5e658a9e01123cd691275c98 in 52ms, sequenceid=6, compaction requested=false 2023-07-11 21:22:27,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:22:27,480 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 21:22:27,480 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 21:22:27,481 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 21:22:27,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/data/default/TestLogRolling-testLogRollOnDatanodeDeath/6444b74f5e658a9e01123cd691275c98/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:22:27,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:27,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 6444b74f5e658a9e01123cd691275c98: 2023-07-11 21:22:27,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1689110536878.6444b74f5e658a9e01123cd691275c98. 2023-07-11 21:22:27,629 INFO [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,44595,1689110532662; all regions closed. 2023-07-11 21:22:28,432 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:22:31,230 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.1689110534594 after 4011ms 2023-07-11 21:22:31,231 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.1689110534594 to hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/oldWALs/jenkins-hbase5.apache.org%2C44595%2C1689110532662.1689110534594 2023-07-11 21:22:31,276 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta.1689110534821.meta after 4002ms 2023-07-11 21:22:31,277 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/WALs/jenkins-hbase5.apache.org,44595,1689110532662/jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta.1689110534821.meta to hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/oldWALs/jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta.1689110534821.meta 2023-07-11 21:22:31,286 DEBUG [RS:0;jenkins-hbase5:44595] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/oldWALs 2023-07-11 21:22:31,286 INFO [RS:0;jenkins-hbase5:44595] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C44595%2C1689110532662.meta:.meta(num 1689110547240) 2023-07-11 21:22:31,299 DEBUG [RS:0;jenkins-hbase5:44595] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/oldWALs 2023-07-11 21:22:31,299 INFO [RS:0;jenkins-hbase5:44595] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C44595%2C1689110532662:(num 1689110547183) 2023-07-11 21:22:31,299 DEBUG [RS:0;jenkins-hbase5:44595] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:22:31,299 INFO [RS:0;jenkins-hbase5:44595] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:22:31,300 INFO [RS:0;jenkins-hbase5:44595] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 21:22:31,300 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 21:22:31,302 INFO [RS:0;jenkins-hbase5:44595] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:44595 2023-07-11 21:22:31,309 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,44595,1689110532662 2023-07-11 21:22:31,309 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:22:31,309 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:22:31,312 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,44595,1689110532662] 2023-07-11 21:22:31,312 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,44595,1689110532662; numProcessing=1 2023-07-11 21:22:31,315 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,44595,1689110532662 already deleted, retry=false 2023-07-11 21:22:31,315 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,44595,1689110532662 expired; onlineServers=0 2023-07-11 21:22:31,315 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,38421,1689110531204' ***** 2023-07-11 21:22:31,315 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 21:22:31,316 DEBUG [M:0;jenkins-hbase5:38421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@216c4785, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 21:22:31,316 INFO [M:0;jenkins-hbase5:38421] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,38421,1689110531204 2023-07-11 21:22:31,316 INFO [M:0;jenkins-hbase5:38421] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,38421,1689110531204; all regions closed. 2023-07-11 21:22:31,316 DEBUG [M:0;jenkins-hbase5:38421] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:22:31,317 DEBUG [M:0;jenkins-hbase5:38421] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 21:22:31,317 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 21:22:31,317 DEBUG [M:0;jenkins-hbase5:38421] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 21:22:31,317 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689110534198] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689110534198,5,FailOnTimeoutGroup] 2023-07-11 21:22:31,317 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689110534198] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689110534198,5,FailOnTimeoutGroup] 2023-07-11 21:22:31,317 INFO [M:0;jenkins-hbase5:38421] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 21:22:31,318 INFO [M:0;jenkins-hbase5:38421] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 21:22:31,318 INFO [M:0;jenkins-hbase5:38421] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-07-11 21:22:31,318 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 21:22:31,319 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:31,319 DEBUG [M:0;jenkins-hbase5:38421] master.HMaster(1512): Stopping service threads 2023-07-11 21:22:31,319 INFO [M:0;jenkins-hbase5:38421] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 21:22:31,320 ERROR [M:0;jenkins-hbase5:38421] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] 2023-07-11 21:22:31,320 INFO [M:0;jenkins-hbase5:38421] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 21:22:31,321 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 21:22:31,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:22:31,321 DEBUG [M:0;jenkins-hbase5:38421] zookeeper.ZKUtil(398): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 21:22:31,322 WARN [M:0;jenkins-hbase5:38421] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 21:22:31,322 INFO [M:0;jenkins-hbase5:38421] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 21:22:31,322 INFO [M:0;jenkins-hbase5:38421] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 21:22:31,323 DEBUG [M:0;jenkins-hbase5:38421] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 21:22:31,323 INFO [M:0;jenkins-hbase5:38421] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:22:31,323 DEBUG [M:0;jenkins-hbase5:38421] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:22:31,323 DEBUG [M:0;jenkins-hbase5:38421] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 21:22:31,323 DEBUG [M:0;jenkins-hbase5:38421] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:22:31,323 INFO [M:0;jenkins-hbase5:38421] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.07 KB heapSize=45.73 KB 2023-07-11 21:22:31,324 WARN [AsyncFSWAL-0-hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData-prefix:jenkins-hbase5.apache.org,38421,1689110531204] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:31,324 DEBUG [master:store-WAL-Roller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase5.apache.org%2C38421%2C1689110531204:(num 1689110533204) roll requested 2023-07-11 21:22:31,361 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42335,DS-32ba4a85-f807-4c06-bb57-9a90f546316c,DISK] 2023-07-11 21:22:31,379 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43477,DS-a877444b-e33c-4996-b833-4de1ba344776,DISK] 2023-07-11 21:22:31,387 INFO [master:store-WAL-Roller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/WALs/jenkins-hbase5.apache.org,38421,1689110531204/jenkins-hbase5.apache.org%2C38421%2C1689110531204.1689110533204 with entries=89, filesize=43.92 KB; new WAL /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/WALs/jenkins-hbase5.apache.org,38421,1689110531204/jenkins-hbase5.apache.org%2C38421%2C1689110531204.1689110551325 2023-07-11 21:22:31,387 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42335,DS-32ba4a85-f807-4c06-bb57-9a90f546316c,DISK], DatanodeInfoWithStorage[127.0.0.1:43477,DS-a877444b-e33c-4996-b833-4de1ba344776,DISK]] 2023-07-11 21:22:31,387 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(716): hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/WALs/jenkins-hbase5.apache.org,38421,1689110531204/jenkins-hbase5.apache.org%2C38421%2C1689110531204.1689110533204 is not closed yet, will try archiving it next time 2023-07-11 21:22:31,387 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:31,388 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-11 21:22:31,389 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/WALs/jenkins-hbase5.apache.org,38421,1689110531204/jenkins-hbase5.apache.org%2C38421%2C1689110531204.1689110533204 2023-07-11 21:22:31,391 WARN [IPC Server handler 4 on default port 33063] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/WALs/jenkins-hbase5.apache.org,38421,1689110531204/jenkins-hbase5.apache.org%2C38421%2C1689110531204.1689110533204 has not been closed. Lease recovery is in progress. RecoveryId = 1024 for block blk_1073741829_1005 2023-07-11 21:22:31,392 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/WALs/jenkins-hbase5.apache.org,38421,1689110531204/jenkins-hbase5.apache.org%2C38421%2C1689110531204.1689110533204 after 3ms 2023-07-11 21:22:31,412 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:22:31,413 INFO [RS:0;jenkins-hbase5:44595] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,44595,1689110532662; zookeeper connection closed. 2023-07-11 21:22:31,413 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): regionserver:44595-0x101c1e014140001, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:22:31,419 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:22:31,428 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6c2b18bf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6c2b18bf 2023-07-11 21:22:31,438 INFO [Listener at localhost/46483] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-11 21:22:31,462 INFO [M:0;jenkins-hbase5:38421] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.07 KB at sequenceid=91 (bloomFilter=true), to=hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f28ebfdf58504fc8a042df0e77f31c2e 2023-07-11 21:22:31,474 DEBUG [M:0;jenkins-hbase5:38421] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f28ebfdf58504fc8a042df0e77f31c2e as hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f28ebfdf58504fc8a042df0e77f31c2e 2023-07-11 21:22:31,485 INFO [M:0;jenkins-hbase5:38421] regionserver.HStore(1080): Added hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f28ebfdf58504fc8a042df0e77f31c2e, entries=11, sequenceid=91, filesize=7.0 K 2023-07-11 21:22:31,487 INFO [M:0;jenkins-hbase5:38421] regionserver.HRegion(2948): Finished flush of dataSize ~38.07 KB/38985, heapSize ~45.72 KB/46816, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 164ms, sequenceid=91, compaction requested=false 2023-07-11 21:22:31,501 INFO [M:0;jenkins-hbase5:38421] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:22:31,501 DEBUG [M:0;jenkins-hbase5:38421] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:22:32,983 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-11 21:22:35,393 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/WALs/jenkins-hbase5.apache.org,38421,1689110531204/jenkins-hbase5.apache.org%2C38421%2C1689110531204.1689110533204 after 4004ms 2023-07-11 21:22:35,393 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/WALs/jenkins-hbase5.apache.org,38421,1689110531204/jenkins-hbase5.apache.org%2C38421%2C1689110531204.1689110533204 to hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/oldWALs/jenkins-hbase5.apache.org%2C38421%2C1689110531204.1689110533204 2023-07-11 21:22:35,400 INFO [WAL-Archive-0] region.MasterRegionUtils(50): Moved hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/MasterData/oldWALs/jenkins-hbase5.apache.org%2C38421%2C1689110531204.1689110533204 to hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/oldWALs/jenkins-hbase5.apache.org%2C38421%2C1689110531204.1689110533204$masterlocalwal$ 2023-07-11 21:22:35,400 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 21:22:35,400 INFO [M:0;jenkins-hbase5:38421] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 21:22:35,401 INFO [M:0;jenkins-hbase5:38421] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:38421 2023-07-11 21:22:35,403 DEBUG [M:0;jenkins-hbase5:38421] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,38421,1689110531204 already deleted, retry=false 2023-07-11 21:22:35,505 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:22:35,505 INFO [M:0;jenkins-hbase5:38421] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,38421,1689110531204; zookeeper connection closed. 2023-07-11 21:22:35,505 DEBUG [Listener at localhost/38687-EventThread] zookeeper.ZKWatcher(600): master:38421-0x101c1e014140000, quorum=127.0.0.1:61507, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:22:35,507 WARN [Listener at localhost/46483] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:22:35,513 INFO [Listener at localhost/46483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:22:35,617 WARN [BP-199629002-172.31.10.131-1689110527177 heartbeating to localhost/127.0.0.1:33063] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:22:35,617 WARN [BP-199629002-172.31.10.131-1689110527177 heartbeating to localhost/127.0.0.1:33063] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-199629002-172.31.10.131-1689110527177 (Datanode Uuid 543707f2-3b69-4998-b776-c114e1ec8a59) service to localhost/127.0.0.1:33063 2023-07-11 21:22:35,618 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/dfs/data/data3/current/BP-199629002-172.31.10.131-1689110527177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:22:35,618 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/dfs/data/data4/current/BP-199629002-172.31.10.131-1689110527177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:22:35,620 WARN [Listener at localhost/46483] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:22:35,623 INFO [Listener at localhost/46483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:22:35,728 WARN [BP-199629002-172.31.10.131-1689110527177 heartbeating to localhost/127.0.0.1:33063] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:22:35,728 WARN [BP-199629002-172.31.10.131-1689110527177 heartbeating to localhost/127.0.0.1:33063] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-199629002-172.31.10.131-1689110527177 (Datanode Uuid 2a7e8178-c9c4-4f77-9f20-abb2ba4df199) service to localhost/127.0.0.1:33063 2023-07-11 21:22:35,729 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/dfs/data/data9/current/BP-199629002-172.31.10.131-1689110527177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:22:35,729 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/dfs/data/data10/current/BP-199629002-172.31.10.131-1689110527177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:22:35,731 WARN [Listener at localhost/46483] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:22:35,737 INFO [Listener at localhost/46483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:22:35,841 WARN [BP-199629002-172.31.10.131-1689110527177 heartbeating to localhost/127.0.0.1:33063] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:22:35,841 WARN [BP-199629002-172.31.10.131-1689110527177 heartbeating to localhost/127.0.0.1:33063] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-199629002-172.31.10.131-1689110527177 (Datanode Uuid a9ec7d05-1d21-4153-9008-ba2aba2fded7) service to localhost/127.0.0.1:33063 2023-07-11 21:22:35,842 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/dfs/data/data7/current/BP-199629002-172.31.10.131-1689110527177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:22:35,842 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/dfs/data/data8/current/BP-199629002-172.31.10.131-1689110527177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:22:35,843 WARN [Listener at localhost/46483] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:22:35,847 INFO [Listener at localhost/46483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:22:35,949 WARN [BP-199629002-172.31.10.131-1689110527177 heartbeating to localhost/127.0.0.1:33063] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:22:35,949 WARN [BP-199629002-172.31.10.131-1689110527177 heartbeating to localhost/127.0.0.1:33063] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-199629002-172.31.10.131-1689110527177 (Datanode Uuid e6a84791-268c-4782-be85-9b910ae66726) service to localhost/127.0.0.1:33063 2023-07-11 21:22:35,950 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/dfs/data/data5/current/BP-199629002-172.31.10.131-1689110527177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:22:35,950 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/dfs/data/data6/current/BP-199629002-172.31.10.131-1689110527177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:22:35,951 WARN [Listener at localhost/46483] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:22:35,955 INFO [Listener at localhost/46483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:22:36,056 WARN [BP-199629002-172.31.10.131-1689110527177 heartbeating to localhost/127.0.0.1:33063] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:22:36,057 WARN [BP-199629002-172.31.10.131-1689110527177 heartbeating to localhost/127.0.0.1:33063] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-199629002-172.31.10.131-1689110527177 (Datanode Uuid 54088582-de4b-4ad0-9d2a-9aae193072fe) service to localhost/127.0.0.1:33063 2023-07-11 21:22:36,057 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/dfs/data/data1/current/BP-199629002-172.31.10.131-1689110527177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:22:36,058 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/cluster_8c6c904e-8de9-dff6-fd1b-a2cd071fa556/dfs/data/data2/current/BP-199629002-172.31.10.131-1689110527177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:22:36,093 INFO [Listener at localhost/46483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:22:36,209 INFO [Listener at localhost/46483] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 21:22:36,255 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-11 21:22:36,268 INFO [Listener at localhost/46483] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=75 (was 10) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@39367933 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1311286300) connection to localhost/127.0.0.1:33063 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46483 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1311286300) connection to localhost/127.0.0.1:33063 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase5:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33063 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase5:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1311286300) connection to localhost/127.0.0.1:33063 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:33063 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase5:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) - Thread LEAK? -, OpenFileDescriptor=468 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=601 (was 574) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 175), AvailableMemoryMB=3191 (was 4099) 2023-07-11 21:22:36,279 INFO [Listener at localhost/46483] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=75, OpenFileDescriptor=468, MaxFileDescriptor=60000, SystemLoadAverage=601, ProcessCount=175, AvailableMemoryMB=3191 2023-07-11 21:22:36,279 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 21:22:36,279 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/hadoop.log.dir so I do NOT create it in target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70 2023-07-11 21:22:36,279 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/93c43c89-8f4f-2030-5968-7a99e80008fc/hadoop.tmp.dir so I do NOT create it in target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70 2023-07-11 21:22:36,279 INFO [Listener at localhost/46483] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/cluster_e43f865e-40a6-dc90-1c29-091f1d6bef49, deleteOnExit=true 2023-07-11 21:22:36,279 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 21:22:36,279 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/test.cache.data in system properties and HBase conf 2023-07-11 21:22:36,280 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 21:22:36,280 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/hadoop.log.dir in system properties and HBase conf 2023-07-11 21:22:36,280 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 21:22:36,280 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 21:22:36,280 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 21:22:36,280 DEBUG [Listener at localhost/46483] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 21:22:36,280 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:22:36,281 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:22:36,281 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 21:22:36,281 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:22:36,281 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 21:22:36,281 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 21:22:36,281 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:22:36,281 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:22:36,281 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 21:22:36,282 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/nfs.dump.dir in system properties and HBase conf 2023-07-11 21:22:36,282 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/java.io.tmpdir in system properties and HBase conf 2023-07-11 21:22:36,282 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:22:36,282 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 21:22:36,282 INFO [Listener at localhost/46483] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 21:22:36,289 WARN [Listener at localhost/46483] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 21:22:36,289 WARN [Listener at localhost/46483] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 21:22:36,336 WARN [Listener at localhost/46483] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:22:36,338 INFO [Listener at localhost/46483] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:22:36,345 INFO [Listener at localhost/46483] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/java.io.tmpdir/Jetty_localhost_44887_hdfs____6aeezl/webapp 2023-07-11 21:22:36,457 INFO [Listener at localhost/46483] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44887 2023-07-11 21:22:36,464 WARN [Listener at localhost/46483] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 21:22:36,464 WARN [Listener at localhost/46483] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 21:22:36,513 WARN [Listener at localhost/40535] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:22:36,525 WARN [Listener at localhost/40535] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:22:36,529 WARN [Listener at localhost/40535] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:22:36,530 INFO [Listener at localhost/40535] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:22:36,536 INFO [Listener at localhost/40535] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/java.io.tmpdir/Jetty_localhost_43161_datanode____sr5mb8/webapp 2023-07-11 21:22:36,646 INFO [Listener at localhost/40535] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43161 2023-07-11 21:22:36,655 WARN [Listener at localhost/41081] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:22:36,666 WARN [Listener at localhost/41081] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:22:36,668 WARN [Listener at localhost/41081] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:22:36,670 INFO [Listener at localhost/41081] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:22:36,673 INFO [Listener at localhost/41081] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/java.io.tmpdir/Jetty_localhost_43043_datanode____au80jb/webapp 2023-07-11 21:22:36,774 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbee0848bf76414d5: Processing first storage report for DS-0edfbb29-1b7c-4352-8eb7-a384d654c370 from datanode 5ad982f7-9ef3-4e22-aab0-3996f0448558 2023-07-11 21:22:36,774 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbee0848bf76414d5: from storage DS-0edfbb29-1b7c-4352-8eb7-a384d654c370 node DatanodeRegistration(127.0.0.1:40723, datanodeUuid=5ad982f7-9ef3-4e22-aab0-3996f0448558, infoPort=38705, infoSecurePort=0, ipcPort=41081, storageInfo=lv=-57;cid=testClusterID;nsid=1262583356;c=1689110556293), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-11 21:22:36,774 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbee0848bf76414d5: Processing first storage report for DS-4f631d5f-02e8-47d9-a360-a5671fdd74e2 from datanode 5ad982f7-9ef3-4e22-aab0-3996f0448558 2023-07-11 21:22:36,775 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbee0848bf76414d5: from storage DS-4f631d5f-02e8-47d9-a360-a5671fdd74e2 node DatanodeRegistration(127.0.0.1:40723, datanodeUuid=5ad982f7-9ef3-4e22-aab0-3996f0448558, infoPort=38705, infoSecurePort=0, ipcPort=41081, storageInfo=lv=-57;cid=testClusterID;nsid=1262583356;c=1689110556293), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:22:36,791 INFO [Listener at localhost/41081] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43043 2023-07-11 21:22:36,802 WARN [Listener at localhost/33141] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:22:36,893 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1b8c6f0862fa53ca: Processing first storage report for DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26 from datanode 62a45136-3281-4ae7-8a82-14ae81023eca 2023-07-11 21:22:36,893 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1b8c6f0862fa53ca: from storage DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26 node DatanodeRegistration(127.0.0.1:38507, datanodeUuid=62a45136-3281-4ae7-8a82-14ae81023eca, infoPort=34845, infoSecurePort=0, ipcPort=33141, storageInfo=lv=-57;cid=testClusterID;nsid=1262583356;c=1689110556293), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:22:36,893 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1b8c6f0862fa53ca: Processing first storage report for DS-0adb5e75-5ef0-4da7-b4d4-9a7a30a26022 from datanode 62a45136-3281-4ae7-8a82-14ae81023eca 2023-07-11 21:22:36,893 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1b8c6f0862fa53ca: from storage DS-0adb5e75-5ef0-4da7-b4d4-9a7a30a26022 node DatanodeRegistration(127.0.0.1:38507, datanodeUuid=62a45136-3281-4ae7-8a82-14ae81023eca, infoPort=34845, infoSecurePort=0, ipcPort=33141, storageInfo=lv=-57;cid=testClusterID;nsid=1262583356;c=1689110556293), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:22:36,913 DEBUG [Listener at localhost/33141] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70 2023-07-11 21:22:36,916 INFO [Listener at localhost/33141] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/cluster_e43f865e-40a6-dc90-1c29-091f1d6bef49/zookeeper_0, clientPort=54692, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/cluster_e43f865e-40a6-dc90-1c29-091f1d6bef49/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/cluster_e43f865e-40a6-dc90-1c29-091f1d6bef49/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 21:22:36,920 INFO [Listener at localhost/33141] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54692 2023-07-11 21:22:36,920 INFO [Listener at localhost/33141] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:36,921 INFO [Listener at localhost/33141] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:36,938 INFO [Listener at localhost/33141] util.FSUtils(471): Created version file at hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b with version=8 2023-07-11 21:22:36,938 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/hbase-staging 2023-07-11 21:22:36,940 INFO [Listener at localhost/33141] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 21:22:36,940 INFO [Listener at localhost/33141] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:22:36,941 INFO [Listener at localhost/33141] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:22:36,941 INFO [Listener at localhost/33141] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:22:36,941 INFO [Listener at localhost/33141] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:22:36,941 INFO [Listener at localhost/33141] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:22:36,941 INFO [Listener at localhost/33141] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:22:36,942 INFO [Listener at localhost/33141] ipc.NettyRpcServer(120): Bind to /172.31.10.131:41779 2023-07-11 21:22:36,943 INFO [Listener at localhost/33141] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:36,944 INFO [Listener at localhost/33141] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:36,946 INFO [Listener at localhost/33141] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41779 connecting to ZooKeeper ensemble=127.0.0.1:54692 2023-07-11 21:22:36,953 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:417790x0, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:22:36,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41779-0x101c1e07b4f0000 connected 2023-07-11 21:22:36,983 DEBUG [Listener at localhost/33141] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:22:36,983 DEBUG [Listener at localhost/33141] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:22:36,984 DEBUG [Listener at localhost/33141] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:22:36,993 DEBUG [Listener at localhost/33141] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41779 2023-07-11 21:22:36,993 DEBUG [Listener at localhost/33141] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41779 2023-07-11 21:22:36,995 DEBUG [Listener at localhost/33141] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41779 2023-07-11 21:22:36,996 DEBUG [Listener at localhost/33141] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41779 2023-07-11 21:22:36,996 DEBUG [Listener at localhost/33141] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41779 2023-07-11 21:22:36,997 INFO [Listener at localhost/33141] master.HMaster(444): hbase.rootdir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b, hbase.cluster.distributed=false 2023-07-11 21:22:37,013 INFO [Listener at localhost/33141] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 21:22:37,013 INFO [Listener at localhost/33141] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:22:37,013 INFO [Listener at localhost/33141] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:22:37,013 INFO [Listener at localhost/33141] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:22:37,013 INFO [Listener at localhost/33141] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:22:37,013 INFO [Listener at localhost/33141] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:22:37,014 INFO [Listener at localhost/33141] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:22:37,016 INFO [Listener at localhost/33141] ipc.NettyRpcServer(120): Bind to /172.31.10.131:46173 2023-07-11 21:22:37,017 INFO [Listener at localhost/33141] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 21:22:37,019 DEBUG [Listener at localhost/33141] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 21:22:37,020 INFO [Listener at localhost/33141] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:37,021 INFO [Listener at localhost/33141] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:37,022 INFO [Listener at localhost/33141] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46173 connecting to ZooKeeper ensemble=127.0.0.1:54692 2023-07-11 21:22:37,025 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:461730x0, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:22:37,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46173-0x101c1e07b4f0001 connected 2023-07-11 21:22:37,026 DEBUG [Listener at localhost/33141] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:22:37,027 DEBUG [Listener at localhost/33141] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:22:37,028 DEBUG [Listener at localhost/33141] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:22:37,028 DEBUG [Listener at localhost/33141] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46173 2023-07-11 21:22:37,028 DEBUG [Listener at localhost/33141] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46173 2023-07-11 21:22:37,031 DEBUG [Listener at localhost/33141] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46173 2023-07-11 21:22:37,051 DEBUG [Listener at localhost/33141] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46173 2023-07-11 21:22:37,055 DEBUG [Listener at localhost/33141] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46173 2023-07-11 21:22:37,061 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,41779,1689110556940 2023-07-11 21:22:37,069 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 21:22:37,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,41779,1689110556940 2023-07-11 21:22:37,071 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:22:37,071 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:22:37,071 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:37,072 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 21:22:37,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 21:22:37,072 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,41779,1689110556940 from backup master directory 2023-07-11 21:22:37,074 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,41779,1689110556940 2023-07-11 21:22:37,074 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 21:22:37,074 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:22:37,074 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,41779,1689110556940 2023-07-11 21:22:37,091 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/hbase.id with ID: e5047579-fabb-47d0-8d98-231530053044 2023-07-11 21:22:37,106 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:37,109 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:37,120 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0e4ee62a to 127.0.0.1:54692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:22:37,125 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20c1ba73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:22:37,125 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:22:37,125 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 21:22:37,126 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:22:37,127 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/data/master/store-tmp 2023-07-11 21:22:37,141 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:37,141 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 21:22:37,141 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:22:37,141 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:22:37,141 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 21:22:37,141 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:22:37,141 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:22:37,141 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:22:37,142 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/WALs/jenkins-hbase5.apache.org,41779,1689110556940 2023-07-11 21:22:37,146 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C41779%2C1689110556940, suffix=, logDir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/WALs/jenkins-hbase5.apache.org,41779,1689110556940, archiveDir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/oldWALs, maxLogs=10 2023-07-11 21:22:37,165 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40723,DS-0edfbb29-1b7c-4352-8eb7-a384d654c370,DISK] 2023-07-11 21:22:37,167 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38507,DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26,DISK] 2023-07-11 21:22:37,169 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/WALs/jenkins-hbase5.apache.org,41779,1689110556940/jenkins-hbase5.apache.org%2C41779%2C1689110556940.1689110557146 2023-07-11 21:22:37,170 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40723,DS-0edfbb29-1b7c-4352-8eb7-a384d654c370,DISK], DatanodeInfoWithStorage[127.0.0.1:38507,DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26,DISK]] 2023-07-11 21:22:37,170 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:22:37,170 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:37,170 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:22:37,170 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:22:37,172 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:22:37,174 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 21:22:37,174 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 21:22:37,175 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:37,176 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:22:37,177 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:22:37,181 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:22:37,184 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:22:37,185 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=689863, jitterRate=-0.12279418110847473}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:22:37,185 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:22:37,190 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 21:22:37,192 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 21:22:37,192 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 21:22:37,192 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 21:22:37,193 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 21:22:37,193 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-11 21:22:37,193 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 21:22:37,194 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 21:22:37,195 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 21:22:37,207 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 21:22:37,207 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 21:22:37,208 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 21:22:37,208 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 21:22:37,208 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 21:22:37,210 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:37,211 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 21:22:37,212 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 21:22:37,213 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 21:22:37,214 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:22:37,214 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:22:37,214 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:37,215 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,41779,1689110556940, sessionid=0x101c1e07b4f0000, setting cluster-up flag (Was=false) 2023-07-11 21:22:37,220 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:37,223 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 21:22:37,224 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,41779,1689110556940 2023-07-11 21:22:37,228 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:37,233 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 21:22:37,234 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,41779,1689110556940 2023-07-11 21:22:37,235 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/.hbase-snapshot/.tmp 2023-07-11 21:22:37,240 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 21:22:37,240 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:22:37,241 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:22:37,241 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:22:37,241 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:22:37,241 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-07-11 21:22:37,241 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:37,241 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:22:37,241 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:37,246 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689110587246 2023-07-11 21:22:37,246 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 21:22:37,246 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 21:22:37,246 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 21:22:37,246 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 21:22:37,247 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 21:22:37,247 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 21:22:37,247 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,247 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 21:22:37,247 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 21:22:37,247 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 21:22:37,248 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 21:22:37,248 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 21:22:37,249 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 21:22:37,249 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 21:22:37,250 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:22:37,251 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689110557250,5,FailOnTimeoutGroup] 2023-07-11 21:22:37,251 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689110557251,5,FailOnTimeoutGroup] 2023-07-11 21:22:37,251 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,251 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 21:22:37,251 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,251 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,262 INFO [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(951): ClusterId : e5047579-fabb-47d0-8d98-231530053044 2023-07-11 21:22:37,263 DEBUG [RS:0;jenkins-hbase5:46173] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 21:22:37,266 DEBUG [RS:0;jenkins-hbase5:46173] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 21:22:37,266 DEBUG [RS:0;jenkins-hbase5:46173] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 21:22:37,267 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 21:22:37,268 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 21:22:37,268 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b 2023-07-11 21:22:37,268 DEBUG [RS:0;jenkins-hbase5:46173] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 21:22:37,269 DEBUG [RS:0;jenkins-hbase5:46173] zookeeper.ReadOnlyZKClient(139): Connect 0x7efa6e66 to 127.0.0.1:54692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:22:37,273 DEBUG [RS:0;jenkins-hbase5:46173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@703d9fc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:22:37,273 DEBUG [RS:0;jenkins-hbase5:46173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74020516, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 21:22:37,279 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:37,281 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 21:22:37,283 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/info 2023-07-11 21:22:37,284 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 21:22:37,284 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:37,284 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 21:22:37,286 DEBUG [RS:0;jenkins-hbase5:46173] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:46173 2023-07-11 21:22:37,286 INFO [RS:0;jenkins-hbase5:46173] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 21:22:37,287 INFO [RS:0;jenkins-hbase5:46173] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 21:22:37,287 DEBUG [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 21:22:37,287 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:22:37,287 INFO [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,41779,1689110556940 with isa=jenkins-hbase5.apache.org/172.31.10.131:46173, startcode=1689110557012 2023-07-11 21:22:37,288 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 21:22:37,288 DEBUG [RS:0;jenkins-hbase5:46173] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 21:22:37,288 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:37,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 21:22:37,291 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47389, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 21:22:37,291 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/table 2023-07-11 21:22:37,293 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41779] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:37,293 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 21:22:37,294 DEBUG [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b 2023-07-11 21:22:37,294 DEBUG [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40535 2023-07-11 21:22:37,294 DEBUG [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 21:22:37,294 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:37,296 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740 2023-07-11 21:22:37,297 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740 2023-07-11 21:22:37,298 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:22:37,298 DEBUG [RS:0;jenkins-hbase5:46173] zookeeper.ZKUtil(162): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:37,298 WARN [RS:0;jenkins-hbase5:46173] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:22:37,298 INFO [RS:0;jenkins-hbase5:46173] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:22:37,298 DEBUG [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:37,300 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,46173,1689110557012] 2023-07-11 21:22:37,302 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-11 21:22:37,304 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 21:22:37,305 DEBUG [RS:0;jenkins-hbase5:46173] zookeeper.ZKUtil(162): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:37,306 DEBUG [RS:0;jenkins-hbase5:46173] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 21:22:37,306 INFO [RS:0;jenkins-hbase5:46173] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 21:22:37,307 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:22:37,307 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=773103, jitterRate=-0.01694907248020172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-11 21:22:37,307 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 21:22:37,308 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 21:22:37,308 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 21:22:37,308 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 21:22:37,308 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 21:22:37,308 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 21:22:37,308 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 21:22:37,308 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 21:22:37,309 INFO [RS:0;jenkins-hbase5:46173] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 21:22:37,310 INFO [RS:0;jenkins-hbase5:46173] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 21:22:37,310 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 21:22:37,310 INFO [RS:0;jenkins-hbase5:46173] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,310 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 21:22:37,310 INFO [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 21:22:37,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 21:22:37,312 INFO [RS:0;jenkins-hbase5:46173] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,312 DEBUG [RS:0;jenkins-hbase5:46173] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:37,312 DEBUG [RS:0;jenkins-hbase5:46173] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:37,312 DEBUG [RS:0;jenkins-hbase5:46173] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:37,312 DEBUG [RS:0;jenkins-hbase5:46173] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:37,312 DEBUG [RS:0;jenkins-hbase5:46173] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:37,313 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 21:22:37,313 DEBUG [RS:0;jenkins-hbase5:46173] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:22:37,313 DEBUG [RS:0;jenkins-hbase5:46173] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:37,313 DEBUG [RS:0;jenkins-hbase5:46173] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:37,313 DEBUG [RS:0;jenkins-hbase5:46173] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:37,313 DEBUG [RS:0;jenkins-hbase5:46173] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:22:37,317 INFO [RS:0;jenkins-hbase5:46173] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,317 INFO [RS:0;jenkins-hbase5:46173] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,317 INFO [RS:0;jenkins-hbase5:46173] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,318 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 21:22:37,332 INFO [RS:0;jenkins-hbase5:46173] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 21:22:37,332 INFO [RS:0;jenkins-hbase5:46173] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,46173,1689110557012-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,347 INFO [RS:0;jenkins-hbase5:46173] regionserver.Replication(203): jenkins-hbase5.apache.org,46173,1689110557012 started 2023-07-11 21:22:37,347 INFO [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,46173,1689110557012, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:46173, sessionid=0x101c1e07b4f0001 2023-07-11 21:22:37,347 DEBUG [RS:0;jenkins-hbase5:46173] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 21:22:37,347 DEBUG [RS:0;jenkins-hbase5:46173] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:37,347 DEBUG [RS:0;jenkins-hbase5:46173] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,46173,1689110557012' 2023-07-11 21:22:37,347 DEBUG [RS:0;jenkins-hbase5:46173] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:22:37,348 DEBUG [RS:0;jenkins-hbase5:46173] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:22:37,348 DEBUG [RS:0;jenkins-hbase5:46173] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 21:22:37,348 DEBUG [RS:0;jenkins-hbase5:46173] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 21:22:37,348 DEBUG [RS:0;jenkins-hbase5:46173] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:37,349 DEBUG [RS:0;jenkins-hbase5:46173] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,46173,1689110557012' 2023-07-11 21:22:37,349 DEBUG [RS:0;jenkins-hbase5:46173] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:22:37,349 DEBUG [RS:0;jenkins-hbase5:46173] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:22:37,349 DEBUG [RS:0;jenkins-hbase5:46173] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 21:22:37,350 INFO [RS:0;jenkins-hbase5:46173] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 21:22:37,350 INFO [RS:0;jenkins-hbase5:46173] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 21:22:37,503 DEBUG [jenkins-hbase5:41779] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-11 21:22:37,504 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,46173,1689110557012, state=OPENING 2023-07-11 21:22:37,506 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 21:22:37,507 INFO [RS:0;jenkins-hbase5:46173] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C46173%2C1689110557012, suffix=, logDir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012, archiveDir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/oldWALs, maxLogs=32 2023-07-11 21:22:37,513 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:37,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,46173,1689110557012}] 2023-07-11 21:22:37,514 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 21:22:37,539 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40723,DS-0edfbb29-1b7c-4352-8eb7-a384d654c370,DISK] 2023-07-11 21:22:37,540 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38507,DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26,DISK] 2023-07-11 21:22:37,544 INFO [RS:0;jenkins-hbase5:46173] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110557508 2023-07-11 21:22:37,544 DEBUG [RS:0;jenkins-hbase5:46173] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40723,DS-0edfbb29-1b7c-4352-8eb7-a384d654c370,DISK], DatanodeInfoWithStorage[127.0.0.1:38507,DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26,DISK]] 2023-07-11 21:22:37,695 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:37,696 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:22:37,698 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:22:37,709 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 21:22:37,709 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:22:37,712 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C46173%2C1689110557012.meta, suffix=.meta, logDir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012, archiveDir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/oldWALs, maxLogs=32 2023-07-11 21:22:37,732 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38507,DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26,DISK] 2023-07-11 21:22:37,732 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40723,DS-0edfbb29-1b7c-4352-8eb7-a384d654c370,DISK] 2023-07-11 21:22:37,743 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.meta.1689110557714.meta 2023-07-11 21:22:37,744 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40723,DS-0edfbb29-1b7c-4352-8eb7-a384d654c370,DISK], DatanodeInfoWithStorage[127.0.0.1:38507,DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26,DISK]] 2023-07-11 21:22:37,744 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:22:37,744 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 21:22:37,745 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 21:22:37,746 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 21:22:37,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 21:22:37,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:37,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 21:22:37,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 21:22:37,749 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 21:22:37,750 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/info 2023-07-11 21:22:37,750 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/info 2023-07-11 21:22:37,751 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 21:22:37,751 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:37,752 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 21:22:37,753 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:22:37,753 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:22:37,754 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 21:22:37,755 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:37,755 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 21:22:37,758 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/table 2023-07-11 21:22:37,758 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/table 2023-07-11 21:22:37,759 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 21:22:37,761 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:37,762 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740 2023-07-11 21:22:37,764 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740 2023-07-11 21:22:37,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-11 21:22:37,769 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 21:22:37,771 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=794966, jitterRate=0.01085275411605835}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-11 21:22:37,771 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 21:22:37,773 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689110557695 2023-07-11 21:22:37,778 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 21:22:37,779 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 21:22:37,784 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,46173,1689110557012, state=OPEN 2023-07-11 21:22:37,790 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 21:22:37,790 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 21:22:37,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 21:22:37,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,46173,1689110557012 in 276 msec 2023-07-11 21:22:37,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 21:22:37,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 486 msec 2023-07-11 21:22:37,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 565 msec 2023-07-11 21:22:37,807 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689110557807, completionTime=-1 2023-07-11 21:22:37,807 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-11 21:22:37,807 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 21:22:37,810 DEBUG [hconnection-0x4b4c77c9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:22:37,812 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:22:37,814 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-11 21:22:37,814 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689110617814 2023-07-11 21:22:37,814 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689110677814 2023-07-11 21:22:37,814 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 7 msec 2023-07-11 21:22:37,825 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41779,1689110556940-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,825 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41779,1689110556940-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,825 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41779,1689110556940-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,825 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:41779, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,825 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 21:22:37,825 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 21:22:37,826 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:22:37,827 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 21:22:37,827 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 21:22:37,829 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:22:37,831 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:22:37,834 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/.tmp/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f 2023-07-11 21:22:37,835 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/.tmp/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f empty. 2023-07-11 21:22:37,836 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/.tmp/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f 2023-07-11 21:22:37,836 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 21:22:37,857 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 21:22:37,858 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8b7b453ce226864b66b45e0f4d67db0f, NAME => 'hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/.tmp 2023-07-11 21:22:37,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:37,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 8b7b453ce226864b66b45e0f4d67db0f, disabling compactions & flushes 2023-07-11 21:22:37,872 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:22:37,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:22:37,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. after waiting 0 ms 2023-07-11 21:22:37,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:22:37,872 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:22:37,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 8b7b453ce226864b66b45e0f4d67db0f: 2023-07-11 21:22:37,876 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:22:37,878 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689110557878"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689110557878"}]},"ts":"1689110557878"} 2023-07-11 21:22:37,881 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 21:22:37,882 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:22:37,883 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110557883"}]},"ts":"1689110557883"} 2023-07-11 21:22:37,885 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 21:22:37,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8b7b453ce226864b66b45e0f4d67db0f, ASSIGN}] 2023-07-11 21:22:37,895 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8b7b453ce226864b66b45e0f4d67db0f, ASSIGN 2023-07-11 21:22:37,897 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8b7b453ce226864b66b45e0f4d67db0f, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,46173,1689110557012; forceNewPlan=false, retain=false 2023-07-11 21:22:38,048 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8b7b453ce226864b66b45e0f4d67db0f, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:38,049 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689110558048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689110558048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689110558048"}]},"ts":"1689110558048"} 2023-07-11 21:22:38,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8b7b453ce226864b66b45e0f4d67db0f, server=jenkins-hbase5.apache.org,46173,1689110557012}] 2023-07-11 21:22:38,210 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:22:38,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8b7b453ce226864b66b45e0f4d67db0f, NAME => 'hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:22:38,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8b7b453ce226864b66b45e0f4d67db0f 2023-07-11 21:22:38,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:38,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 8b7b453ce226864b66b45e0f4d67db0f 2023-07-11 21:22:38,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 8b7b453ce226864b66b45e0f4d67db0f 2023-07-11 21:22:38,212 INFO [StoreOpener-8b7b453ce226864b66b45e0f4d67db0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8b7b453ce226864b66b45e0f4d67db0f 2023-07-11 21:22:38,214 DEBUG [StoreOpener-8b7b453ce226864b66b45e0f4d67db0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f/info 2023-07-11 21:22:38,214 DEBUG [StoreOpener-8b7b453ce226864b66b45e0f4d67db0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f/info 2023-07-11 21:22:38,214 INFO [StoreOpener-8b7b453ce226864b66b45e0f4d67db0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b7b453ce226864b66b45e0f4d67db0f columnFamilyName info 2023-07-11 21:22:38,215 INFO [StoreOpener-8b7b453ce226864b66b45e0f4d67db0f-1] regionserver.HStore(310): Store=8b7b453ce226864b66b45e0f4d67db0f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:38,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f 2023-07-11 21:22:38,217 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f 2023-07-11 21:22:38,220 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 8b7b453ce226864b66b45e0f4d67db0f 2023-07-11 21:22:38,222 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:22:38,223 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 8b7b453ce226864b66b45e0f4d67db0f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=831303, jitterRate=0.05705711245536804}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:22:38,223 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 8b7b453ce226864b66b45e0f4d67db0f: 2023-07-11 21:22:38,224 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f., pid=6, masterSystemTime=1689110558204 2023-07-11 21:22:38,227 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:22:38,227 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:22:38,228 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8b7b453ce226864b66b45e0f4d67db0f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:38,228 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689110558227"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689110558227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689110558227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689110558227"}]},"ts":"1689110558227"} 2023-07-11 21:22:38,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 21:22:38,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8b7b453ce226864b66b45e0f4d67db0f, server=jenkins-hbase5.apache.org,46173,1689110557012 in 179 msec 2023-07-11 21:22:38,236 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 21:22:38,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8b7b453ce226864b66b45e0f4d67db0f, ASSIGN in 342 msec 2023-07-11 21:22:38,238 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:22:38,238 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110558238"}]},"ts":"1689110558238"} 2023-07-11 21:22:38,240 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 21:22:38,352 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 21:22:38,353 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:22:38,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 527 msec 2023-07-11 21:22:38,468 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:22:38,468 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:38,473 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 21:22:38,490 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:22:38,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 27 msec 2023-07-11 21:22:38,506 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 21:22:38,520 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:22:38,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 27 msec 2023-07-11 21:22:38,544 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 21:22:38,560 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 21:22:38,560 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.486sec 2023-07-11 21:22:38,560 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 21:22:38,561 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 21:22:38,561 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 21:22:38,561 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41779,1689110556940-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 21:22:38,561 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41779,1689110556940-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 21:22:38,563 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 21:22:38,604 DEBUG [Listener at localhost/33141] zookeeper.ReadOnlyZKClient(139): Connect 0x74604bbe to 127.0.0.1:54692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:22:38,609 DEBUG [Listener at localhost/33141] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b51d384, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:22:38,611 DEBUG [hconnection-0x147e1701-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:22:38,613 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:22:38,616 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,41779,1689110556940 2023-07-11 21:22:38,617 INFO [Listener at localhost/33141] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:22:38,621 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-11 21:22:38,621 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:22:38,622 INFO [Listener at localhost/33141] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-11 21:22:38,624 DEBUG [Listener at localhost/33141] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 21:22:38,631 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 21:22:38,634 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-07-11 21:22:38,634 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-07-11 21:22:38,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:22:38,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:38,639 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:22:38,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testCompactionRecordDoesntBlockRolling" procId is: 9 2023-07-11 21:22:38,640 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:22:38,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:22:38,642 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a 2023-07-11 21:22:38,643 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a empty. 2023-07-11 21:22:38,644 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a 2023-07-11 21:22:38,644 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testCompactionRecordDoesntBlockRolling regions 2023-07-11 21:22:38,663 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/.tabledesc/.tableinfo.0000000001 2023-07-11 21:22:38,664 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7e838891bcf8e31591c9f8cc2f947b1a, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/.tmp 2023-07-11 21:22:38,678 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:38,679 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1604): Closing 7e838891bcf8e31591c9f8cc2f947b1a, disabling compactions & flushes 2023-07-11 21:22:38,679 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:22:38,679 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:22:38,679 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. after waiting 0 ms 2023-07-11 21:22:38,679 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:22:38,679 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:22:38,679 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1558): Region close journal for 7e838891bcf8e31591c9f8cc2f947b1a: 2023-07-11 21:22:38,682 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:22:38,684 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1689110558683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689110558683"}]},"ts":"1689110558683"} 2023-07-11 21:22:38,686 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 21:22:38,687 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:22:38,688 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110558687"}]},"ts":"1689110558687"} 2023-07-11 21:22:38,689 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLING in hbase:meta 2023-07-11 21:22:38,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=7e838891bcf8e31591c9f8cc2f947b1a, ASSIGN}] 2023-07-11 21:22:38,696 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=7e838891bcf8e31591c9f8cc2f947b1a, ASSIGN 2023-07-11 21:22:38,698 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=7e838891bcf8e31591c9f8cc2f947b1a, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,46173,1689110557012; forceNewPlan=false, retain=false 2023-07-11 21:22:38,849 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7e838891bcf8e31591c9f8cc2f947b1a, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:38,849 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1689110558849"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689110558849"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689110558849"}]},"ts":"1689110558849"} 2023-07-11 21:22:38,852 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 7e838891bcf8e31591c9f8cc2f947b1a, server=jenkins-hbase5.apache.org,46173,1689110557012}] 2023-07-11 21:22:39,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:22:39,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7e838891bcf8e31591c9f8cc2f947b1a, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:22:39,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testCompactionRecordDoesntBlockRolling 7e838891bcf8e31591c9f8cc2f947b1a 2023-07-11 21:22:39,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:22:39,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 7e838891bcf8e31591c9f8cc2f947b1a 2023-07-11 21:22:39,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 7e838891bcf8e31591c9f8cc2f947b1a 2023-07-11 21:22:39,014 INFO [StoreOpener-7e838891bcf8e31591c9f8cc2f947b1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7e838891bcf8e31591c9f8cc2f947b1a 2023-07-11 21:22:39,016 DEBUG [StoreOpener-7e838891bcf8e31591c9f8cc2f947b1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info 2023-07-11 21:22:39,016 DEBUG [StoreOpener-7e838891bcf8e31591c9f8cc2f947b1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info 2023-07-11 21:22:39,017 INFO [StoreOpener-7e838891bcf8e31591c9f8cc2f947b1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e838891bcf8e31591c9f8cc2f947b1a columnFamilyName info 2023-07-11 21:22:39,017 INFO [StoreOpener-7e838891bcf8e31591c9f8cc2f947b1a-1] regionserver.HStore(310): Store=7e838891bcf8e31591c9f8cc2f947b1a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:22:39,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a 2023-07-11 21:22:39,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a 2023-07-11 21:22:39,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 7e838891bcf8e31591c9f8cc2f947b1a 2023-07-11 21:22:39,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:22:39,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 7e838891bcf8e31591c9f8cc2f947b1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=783531, jitterRate=-0.0036893635988235474}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:22:39,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 7e838891bcf8e31591c9f8cc2f947b1a: 2023-07-11 21:22:39,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a., pid=11, masterSystemTime=1689110559005 2023-07-11 21:22:39,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:22:39,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:22:39,030 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7e838891bcf8e31591c9f8cc2f947b1a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:39,030 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1689110559029"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689110559029"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689110559029"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689110559029"}]},"ts":"1689110559029"} 2023-07-11 21:22:39,035 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-11 21:22:39,035 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 7e838891bcf8e31591c9f8cc2f947b1a, server=jenkins-hbase5.apache.org,46173,1689110557012 in 180 msec 2023-07-11 21:22:39,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-11 21:22:39,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=7e838891bcf8e31591c9f8cc2f947b1a, ASSIGN in 341 msec 2023-07-11 21:22:39,039 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:22:39,040 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110559039"}]},"ts":"1689110559039"} 2023-07-11 21:22:39,041 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLED in hbase:meta 2023-07-11 21:22:39,044 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:22:39,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling in 409 msec 2023-07-11 21:22:41,418 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:22:41,418 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 21:22:43,248 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-11 21:22:43,321 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 21:22:43,322 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 21:22:43,323 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-11 21:22:48,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:22:48,643 INFO [Listener at localhost/33141] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testCompactionRecordDoesntBlockRolling, procId: 9 completed 2023-07-11 21:22:48,647 DEBUG [Listener at localhost/33141] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:48,647 DEBUG [Listener at localhost/33141] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:22:48,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(936): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-07-11 21:22:48,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] procedure.ProcedureCoordinator(165): Submitting procedure hbase:namespace 2023-07-11 21:22:48,671 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase:namespace' 2023-07-11 21:22:48,671 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 21:22:48,672 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase:namespace' starting 'acquire' 2023-07-11 21:22:48,672 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase:namespace', kicking off acquire phase on members. 2023-07-11 21:22:48,672 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-07-11 21:22:48,672 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-11 21:22:48,674 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 21:22:48,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 21:22:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:22:48,675 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase:namespace 2023-07-11 21:22:48,675 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,675 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:22:48,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-07-11 21:22:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 21:22:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-11 21:22:48,677 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase:namespace 2023-07-11 21:22:48,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase:namespace 2023-07-11 21:22:48,683 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase:namespace' with timeout 60000ms 2023-07-11 21:22:48,683 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 21:22:48,684 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase:namespace' starting 'acquire' stage 2023-07-11 21:22:48,684 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 21:22:48,684 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 21:22:48,684 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:22:48,685 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. started... 2023-07-11 21:22:48,685 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b7b453ce226864b66b45e0f4d67db0f 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 21:22:48,707 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f/.tmp/info/9573c3aa836a449e974a26598501cbe7 2023-07-11 21:22:48,721 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f/.tmp/info/9573c3aa836a449e974a26598501cbe7 as hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f/info/9573c3aa836a449e974a26598501cbe7 2023-07-11 21:22:48,730 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f/info/9573c3aa836a449e974a26598501cbe7, entries=2, sequenceid=6, filesize=4.8 K 2023-07-11 21:22:48,732 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8b7b453ce226864b66b45e0f4d67db0f in 47ms, sequenceid=6, compaction requested=false 2023-07-11 21:22:48,733 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b7b453ce226864b66b45e0f4d67db0f: 2023-07-11 21:22:48,733 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:22:48,733 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 21:22:48,733 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 21:22:48,734 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,734 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase:namespace' locally acquired 2023-07-11 21:22:48,734 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,46173,1689110557012' joining acquired barrier for procedure (hbase:namespace) in zk 2023-07-11 21:22:48,737 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,737 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-11 21:22:48,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:22:48,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:22:48,738 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace 2023-07-11 21:22:48,738 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase:namespace' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:22:48,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:22:48,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:22:48,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-11 21:22:48,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:22:48,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,46173,1689110557012' joining acquired barrier for procedure 'hbase:namespace' on coordinator 2023-07-11 21:22:48,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c6fa4ed[Count = 0] remaining members to acquire global barrier 2023-07-11 21:22:48,741 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase:namespace' starting 'in-barrier' execution. 2023-07-11 21:22:48,741 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-11 21:22:48,744 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-07-11 21:22:48,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-11 21:22:48,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-11 21:22:48,745 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,745 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:22:48,745 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase:namespace' received 'reached' from coordinator. 2023-07-11 21:22:48,745 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase:namespace' locally completed 2023-07-11 21:22:48,745 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase:namespace' completed for member 'jenkins-hbase5.apache.org,46173,1689110557012' in zk 2023-07-11 21:22:48,749 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase:namespace' has notified controller of completion 2023-07-11 21:22:48,749 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:22:48,749 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase:namespace' completed. 2023-07-11 21:22:48,755 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:22:48,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:22:48,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:22:48,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:22:48,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-11 21:22:48,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:22:48,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-11 21:22:48,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase:namespace' member 'jenkins-hbase5.apache.org,46173,1689110557012': 2023-07-11 21:22:48,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,46173,1689110557012' released barrier for procedure'hbase:namespace', counting down latch. Waiting for 0 more 2023-07-11 21:22:48,764 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase:namespace' execution completed 2023-07-11 21:22:48,764 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:22:48,764 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:22:48,764 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase:namespace 2023-07-11 21:22:48,764 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase:namespaceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 21:22:48,766 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-07-11 21:22:48,766 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-07-11 21:22:48,766 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 21:22:48,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase:namespace 2023-07-11 21:22:48,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-07-11 21:22:48,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase:namespace 2023-07-11 21:22:48,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:22:48,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:22:48,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 21:22:48,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:22:48,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:22:48,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-07-11 21:22:48,767 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-11 21:22:48,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:22:48,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-11 21:22:48,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,769 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:22:48,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-11 21:22:48,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,779 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,779 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 21:22:48,779 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-11 21:22:48,780 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 21:22:48,780 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-11 21:22:48,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 21:22:48,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:22:48,780 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:22:48,780 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:48,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase:namespace' 2023-07-11 21:22:48,780 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-07-11 21:22:48,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 21:22:48,781 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-07-11 21:22:48,781 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-07-11 21:22:48,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 21:22:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:22:48,783 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase:namespace'' to complete. (max 20000 ms per retry) 2023-07-11 21:22:48,783 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-11 21:22:58,784 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 21:22:58,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 21:22:58,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(936): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-07-11 21:22:58,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,807 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-11 21:22:58,807 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 21:22:58,808 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-11 21:22:58,808 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-11 21:22:58,808 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,808 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,810 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 21:22:58,810 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 21:22:58,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:22:58,810 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,810 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:22:58,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 21:22:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,811 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,812 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-11 21:22:58,812 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 21:22:58,813 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-11 21:22:58,813 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 21:22:58,813 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 21:22:58,813 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:22:58,813 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. started... 2023-07-11 21:22:58,814 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7e838891bcf8e31591c9f8cc2f947b1a 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-11 21:22:58,853 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/.tmp/info/132696ff8d6342ceb95efbefd13c0c33 2023-07-11 21:22:58,872 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/.tmp/info/132696ff8d6342ceb95efbefd13c0c33 as hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/132696ff8d6342ceb95efbefd13c0c33 2023-07-11 21:22:58,882 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/132696ff8d6342ceb95efbefd13c0c33, entries=1, sequenceid=5, filesize=5.8 K 2023-07-11 21:22:58,884 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 7e838891bcf8e31591c9f8cc2f947b1a in 70ms, sequenceid=5, compaction requested=false 2023-07-11 21:22:58,885 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7e838891bcf8e31591c9f8cc2f947b1a: 2023-07-11 21:22:58,885 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:22:58,885 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 21:22:58,885 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 21:22:58,885 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,885 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-11 21:22:58,886 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,46173,1689110557012' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-11 21:22:58,887 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,887 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:22:58,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:22:58,888 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,888 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:22:58,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:22:58,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:22:58,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:22:58,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,46173,1689110557012' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-11 21:22:58,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@285025b8[Count = 0] remaining members to acquire global barrier 2023-07-11 21:22:58,890 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-11 21:22:58,890 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,891 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,891 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-11 21:22:58,891 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-11 21:22:58,892 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase5.apache.org,46173,1689110557012' in zk 2023-07-11 21:22:58,892 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,892 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:22:58,895 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-11 21:22:58,895 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:22:58,895 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,895 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-11 21:22:58,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:22:58,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:22:58,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:22:58,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:22:58,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:22:58,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase5.apache.org,46173,1689110557012': 2023-07-11 21:22:58,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,46173,1689110557012' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-11 21:22:58,900 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-11 21:22:58,900 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:22:58,900 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:22:58,900 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,900 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 21:22:58,910 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,910 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,910 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 21:22:58,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:22:58,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:22:58,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 21:22:58,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:22:58,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:22:58,912 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:22:58,914 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:22:58,920 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,920 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 21:22:58,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 21:22:58,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:22:58,920 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,921 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,921 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 21:22:58,921 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:22:58,921 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:22:58,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 21:22:58,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:22:58,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-11 21:22:58,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 21:22:58,921 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,922 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,922 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:22:58,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-11 21:22:58,923 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-11 21:22:58,923 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-11 21:23:08,923 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 21:23:08,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 21:23:08,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(936): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-07-11 21:23:08,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-07-11 21:23:08,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,934 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-11 21:23:08,934 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 21:23:08,935 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-11 21:23:08,935 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-11 21:23:08,935 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,935 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,937 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,937 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 21:23:08,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 21:23:08,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:23:08,937 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,937 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:23:08,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 21:23:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,938 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,938 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-07-11 21:23:08,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,939 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-11 21:23:08,939 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 21:23:08,939 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-11 21:23:08,939 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 21:23:08,939 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 21:23:08,939 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:23:08,940 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. started... 2023-07-11 21:23:08,940 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7e838891bcf8e31591c9f8cc2f947b1a 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-11 21:23:08,960 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/.tmp/info/27ed6a8e7f774d7e9216c5787bd5287e 2023-07-11 21:23:08,969 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/.tmp/info/27ed6a8e7f774d7e9216c5787bd5287e as hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/27ed6a8e7f774d7e9216c5787bd5287e 2023-07-11 21:23:08,977 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/27ed6a8e7f774d7e9216c5787bd5287e, entries=1, sequenceid=9, filesize=5.8 K 2023-07-11 21:23:08,978 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 7e838891bcf8e31591c9f8cc2f947b1a in 38ms, sequenceid=9, compaction requested=false 2023-07-11 21:23:08,979 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7e838891bcf8e31591c9f8cc2f947b1a: 2023-07-11 21:23:08,979 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:23:08,979 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 21:23:08,979 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 21:23:08,979 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,979 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-11 21:23:08,979 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,46173,1689110557012' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-11 21:23:08,981 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,981 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:23:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:23:08,981 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,981 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:23:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:23:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:23:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:23:08,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,46173,1689110557012' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-11 21:23:08,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d52aed6[Count = 0] remaining members to acquire global barrier 2023-07-11 21:23:08,983 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-11 21:23:08,984 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,985 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,985 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-11 21:23:08,985 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-11 21:23:08,985 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase5.apache.org,46173,1689110557012' in zk 2023-07-11 21:23:08,985 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,985 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:23:08,988 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,988 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-11 21:23:08,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:23:08,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:23:08,989 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:23:08,989 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-11 21:23:08,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:23:08,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:23:08,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:23:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase5.apache.org,46173,1689110557012': 2023-07-11 21:23:08,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,46173,1689110557012' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-11 21:23:08,993 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-11 21:23:08,993 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:23:08,993 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:23:08,993 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,993 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 21:23:08,995 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,995 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:23:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:23:08,995 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 21:23:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:23:08,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 21:23:08,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:23:08,996 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:23:08,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,998 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:08,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:23:08,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:08,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:09,000 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:09,001 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 21:23:09,001 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:09,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 21:23:09,001 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:09,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:23:09,001 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 21:23:09,001 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:09,001 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:23:09,001 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:09,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-11 21:23:09,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 21:23:09,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 21:23:09,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:23:09,002 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:09,002 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:09,002 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-11 21:23:09,003 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-11 21:23:19,003 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 21:23:19,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 21:23:19,023 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40723,DS-0edfbb29-1b7c-4352-8eb7-a384d654c370,DISK] 2023-07-11 21:23:19,024 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38507,DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26,DISK] 2023-07-11 21:23:19,027 INFO [Listener at localhost/33141] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110557508 with entries=13, filesize=6.36 KB; new WAL /user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110599007 2023-07-11 21:23:19,027 DEBUG [Listener at localhost/33141] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40723,DS-0edfbb29-1b7c-4352-8eb7-a384d654c370,DISK], DatanodeInfoWithStorage[127.0.0.1:38507,DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26,DISK]] 2023-07-11 21:23:19,027 DEBUG [Listener at localhost/33141] wal.AbstractFSWAL(716): hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110557508 is not closed yet, will try archiving it next time 2023-07-11 21:23:19,030 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110557508 not finished, retry = 0 2023-07-11 21:23:19,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(936): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-07-11 21:23:19,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-07-11 21:23:19,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,035 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-11 21:23:19,035 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 21:23:19,035 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-11 21:23:19,035 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-11 21:23:19,036 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,036 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,037 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,037 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 21:23:19,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 21:23:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:23:19,037 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,038 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:23:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 21:23:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,038 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,039 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-07-11 21:23:19,039 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,039 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-11 21:23:19,039 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 21:23:19,039 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-11 21:23:19,039 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 21:23:19,039 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 21:23:19,039 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:23:19,039 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. started... 2023-07-11 21:23:19,040 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7e838891bcf8e31591c9f8cc2f947b1a 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-11 21:23:19,055 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=13 (bloomFilter=true), to=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/.tmp/info/c3fd3a2fe8d54d54af348848508318ca 2023-07-11 21:23:19,064 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/.tmp/info/c3fd3a2fe8d54d54af348848508318ca as hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/c3fd3a2fe8d54d54af348848508318ca 2023-07-11 21:23:19,078 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/c3fd3a2fe8d54d54af348848508318ca, entries=1, sequenceid=13, filesize=5.8 K 2023-07-11 21:23:19,080 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 7e838891bcf8e31591c9f8cc2f947b1a in 41ms, sequenceid=13, compaction requested=true 2023-07-11 21:23:19,080 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7e838891bcf8e31591c9f8cc2f947b1a: 2023-07-11 21:23:19,080 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:23:19,080 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 21:23:19,081 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 21:23:19,081 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,081 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-11 21:23:19,081 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,46173,1689110557012' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-11 21:23:19,084 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,084 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:23:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:23:19,085 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,085 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:23:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:23:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:23:19,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:23:19,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,46173,1689110557012' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-11 21:23:19,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d6c73ba[Count = 0] remaining members to acquire global barrier 2023-07-11 21:23:19,087 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-11 21:23:19,087 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,088 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,089 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-11 21:23:19,089 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-11 21:23:19,089 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase5.apache.org,46173,1689110557012' in zk 2023-07-11 21:23:19,089 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,089 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:23:19,090 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-11 21:23:19,090 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,090 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:23:19,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:23:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:23:19,090 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-11 21:23:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:23:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:23:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:23:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase5.apache.org,46173,1689110557012': 2023-07-11 21:23:19,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,46173,1689110557012' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-11 21:23:19,093 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-11 21:23:19,094 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:23:19,094 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:23:19,094 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,094 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 21:23:19,095 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,095 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:23:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:23:19,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,095 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 21:23:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:23:19,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 21:23:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:23:19,096 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:23:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,097 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:23:19,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,101 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,101 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,101 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,101 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:19,101 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-11 21:23:19,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 21:23:19,101 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,101 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:23:19,101 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:19,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-11 21:23:19,101 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 21:23:19,102 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 21:23:19,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 21:23:19,102 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-11 21:23:19,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:23:19,102 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-11 21:23:19,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 21:23:19,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:23:19,131 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110557508 to hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/oldWALs/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110557508 2023-07-11 21:23:29,102 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 21:23:29,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 21:23:29,105 DEBUG [Listener at localhost/33141] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 21:23:29,109 DEBUG [Listener at localhost/33141] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 17694 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 21:23:29,111 DEBUG [Listener at localhost/33141] regionserver.HStore(1912): 7e838891bcf8e31591c9f8cc2f947b1a/info is initiating minor compaction (all files) 2023-07-11 21:23:29,111 INFO [Listener at localhost/33141] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 21:23:29,111 INFO [Listener at localhost/33141] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:29,111 INFO [Listener at localhost/33141] regionserver.HRegion(2259): Starting compaction of 7e838891bcf8e31591c9f8cc2f947b1a/info in TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:23:29,111 INFO [Listener at localhost/33141] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/132696ff8d6342ceb95efbefd13c0c33, hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/27ed6a8e7f774d7e9216c5787bd5287e, hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/c3fd3a2fe8d54d54af348848508318ca] into tmpdir=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/.tmp, totalSize=17.3 K 2023-07-11 21:23:29,113 DEBUG [Listener at localhost/33141] compactions.Compactor(207): Compacting 132696ff8d6342ceb95efbefd13c0c33, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689110578797 2023-07-11 21:23:29,113 DEBUG [Listener at localhost/33141] compactions.Compactor(207): Compacting 27ed6a8e7f774d7e9216c5787bd5287e, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689110588926 2023-07-11 21:23:29,114 DEBUG [Listener at localhost/33141] compactions.Compactor(207): Compacting c3fd3a2fe8d54d54af348848508318ca, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689110599005 2023-07-11 21:23:29,172 INFO [Listener at localhost/33141] throttle.PressureAwareThroughputController(145): 7e838891bcf8e31591c9f8cc2f947b1a#info#compaction#9 average throughput is unlimited, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 21:23:29,216 DEBUG [Listener at localhost/33141] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/.tmp/info/fb1237fcc8454cb9906e7ad2315ff26e as hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/fb1237fcc8454cb9906e7ad2315ff26e 2023-07-11 21:23:29,239 INFO [Listener at localhost/33141] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7e838891bcf8e31591c9f8cc2f947b1a/info of 7e838891bcf8e31591c9f8cc2f947b1a into fb1237fcc8454cb9906e7ad2315ff26e(size=7.9 K), total size for store is 7.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 21:23:29,240 DEBUG [Listener at localhost/33141] regionserver.HRegion(2289): Compaction status journal for 7e838891bcf8e31591c9f8cc2f947b1a: 2023-07-11 21:23:29,262 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40723,DS-0edfbb29-1b7c-4352-8eb7-a384d654c370,DISK] 2023-07-11 21:23:29,262 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38507,DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26,DISK] 2023-07-11 21:23:29,269 INFO [Listener at localhost/33141] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110599007 with entries=4, filesize=2.43 KB; new WAL /user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110609243 2023-07-11 21:23:29,269 DEBUG [Listener at localhost/33141] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40723,DS-0edfbb29-1b7c-4352-8eb7-a384d654c370,DISK], DatanodeInfoWithStorage[127.0.0.1:38507,DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26,DISK]] 2023-07-11 21:23:29,269 DEBUG [Listener at localhost/33141] wal.AbstractFSWAL(716): hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110599007 is not closed yet, will try archiving it next time 2023-07-11 21:23:29,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(936): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-07-11 21:23:29,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-07-11 21:23:29,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,280 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-11 21:23:29,280 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 21:23:29,281 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-11 21:23:29,281 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-11 21:23:29,282 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,282 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,286 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,286 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 21:23:29,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 21:23:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:23:29,287 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,287 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 21:23:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 21:23:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,288 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,289 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-07-11 21:23:29,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,289 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-11 21:23:29,289 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 21:23:29,289 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-11 21:23:29,290 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 21:23:29,290 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 21:23:29,290 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:23:29,290 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. started... 2023-07-11 21:23:29,290 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7e838891bcf8e31591c9f8cc2f947b1a 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-11 21:23:29,312 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=18 (bloomFilter=true), to=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/.tmp/info/a4ded51a7f6a4167be8a57c83ce231d4 2023-07-11 21:23:29,324 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/.tmp/info/a4ded51a7f6a4167be8a57c83ce231d4 as hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/a4ded51a7f6a4167be8a57c83ce231d4 2023-07-11 21:23:29,332 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/a4ded51a7f6a4167be8a57c83ce231d4, entries=1, sequenceid=18, filesize=5.8 K 2023-07-11 21:23:29,333 INFO [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 7e838891bcf8e31591c9f8cc2f947b1a in 43ms, sequenceid=18, compaction requested=false 2023-07-11 21:23:29,333 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7e838891bcf8e31591c9f8cc2f947b1a: 2023-07-11 21:23:29,333 DEBUG [rs(jenkins-hbase5.apache.org,46173,1689110557012)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:23:29,333 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 21:23:29,334 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 21:23:29,334 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,334 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-11 21:23:29,334 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,46173,1689110557012' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-11 21:23:29,336 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,336 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:23:29,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:23:29,337 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,337 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 21:23:29,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:23:29,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:23:29,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:23:29,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,46173,1689110557012' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-11 21:23:29,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c75e636[Count = 0] remaining members to acquire global barrier 2023-07-11 21:23:29,340 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-11 21:23:29,340 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,343 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,343 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 21:23:29,344 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,345 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-11 21:23:29,345 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-11 21:23:29,345 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase5.apache.org,46173,1689110557012' in zk 2023-07-11 21:23:29,346 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-11 21:23:29,346 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,346 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:23:29,347 DEBUG [member: 'jenkins-hbase5.apache.org,46173,1689110557012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-11 21:23:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:23:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:23:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:23:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:23:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:23:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase5.apache.org,46173,1689110557012': 2023-07-11 21:23:29,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,46173,1689110557012' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-11 21:23:29,351 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-11 21:23:29,351 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 21:23:29,352 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 21:23:29,352 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,352 INFO [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 21:23:29,353 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,354 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 21:23:29,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 21:23:29,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,354 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 21:23:29,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 21:23:29,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:23:29,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 21:23:29,355 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 21:23:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,357 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 21:23:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,362 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,362 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 21:23:29,362 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 21:23:29,363 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 21:23:29,363 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:23:29,363 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:29,363 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,363 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,363 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-11 21:23:29,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-11 21:23:29,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-11 21:23:29,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 21:23:29,363 DEBUG [(jenkins-hbase5.apache.org,41779,1689110556940)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 21:23:29,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 21:23:29,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:23:29,365 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-11 21:23:29,365 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-11 21:23:39,365 DEBUG [Listener at localhost/33141] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 21:23:39,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41779] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 21:23:39,385 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40723,DS-0edfbb29-1b7c-4352-8eb7-a384d654c370,DISK] 2023-07-11 21:23:39,385 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38507,DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26,DISK] 2023-07-11 21:23:39,387 INFO [Listener at localhost/33141] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110609243 with entries=3, filesize=1.94 KB; new WAL /user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110619370 2023-07-11 21:23:39,387 DEBUG [Listener at localhost/33141] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40723,DS-0edfbb29-1b7c-4352-8eb7-a384d654c370,DISK], DatanodeInfoWithStorage[127.0.0.1:38507,DS-357d17f8-b51c-4cac-8fb9-1882d83bbd26,DISK]] 2023-07-11 21:23:39,388 DEBUG [Listener at localhost/33141] wal.AbstractFSWAL(716): hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110609243 is not closed yet, will try archiving it next time 2023-07-11 21:23:39,388 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 21:23:39,388 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/WALs/jenkins-hbase5.apache.org,46173,1689110557012/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110599007 to hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/oldWALs/jenkins-hbase5.apache.org%2C46173%2C1689110557012.1689110599007 2023-07-11 21:23:39,388 INFO [Listener at localhost/33141] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 21:23:39,388 DEBUG [Listener at localhost/33141] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74604bbe to 127.0.0.1:54692 2023-07-11 21:23:39,389 DEBUG [Listener at localhost/33141] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:23:39,389 DEBUG [Listener at localhost/33141] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 21:23:39,389 DEBUG [Listener at localhost/33141] util.JVMClusterUtil(257): Found active master hash=38191493, stopped=false 2023-07-11 21:23:39,389 INFO [Listener at localhost/33141] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,41779,1689110556940 2023-07-11 21:23:39,391 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 21:23:39,391 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:23:39,391 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 21:23:39,391 INFO [Listener at localhost/33141] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 21:23:39,391 DEBUG [Listener at localhost/33141] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e4ee62a to 127.0.0.1:54692 2023-07-11 21:23:39,392 DEBUG [Listener at localhost/33141] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:23:39,392 INFO [Listener at localhost/33141] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,46173,1689110557012' ***** 2023-07-11 21:23:39,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:23:39,392 INFO [Listener at localhost/33141] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 21:23:39,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:23:39,392 INFO [RS:0;jenkins-hbase5:46173] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 21:23:39,392 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 21:23:39,392 INFO [RS:0;jenkins-hbase5:46173] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 21:23:39,393 INFO [RS:0;jenkins-hbase5:46173] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 21:23:39,393 INFO [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(3305): Received CLOSE for 8b7b453ce226864b66b45e0f4d67db0f 2023-07-11 21:23:39,393 INFO [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(3305): Received CLOSE for 7e838891bcf8e31591c9f8cc2f947b1a 2023-07-11 21:23:39,393 INFO [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:39,393 DEBUG [RS:0;jenkins-hbase5:46173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7efa6e66 to 127.0.0.1:54692 2023-07-11 21:23:39,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 8b7b453ce226864b66b45e0f4d67db0f, disabling compactions & flushes 2023-07-11 21:23:39,393 DEBUG [RS:0;jenkins-hbase5:46173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:23:39,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:23:39,393 INFO [RS:0;jenkins-hbase5:46173] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 21:23:39,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:23:39,394 INFO [RS:0;jenkins-hbase5:46173] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 21:23:39,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. after waiting 0 ms 2023-07-11 21:23:39,394 INFO [RS:0;jenkins-hbase5:46173] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 21:23:39,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:23:39,394 INFO [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 21:23:39,394 INFO [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-11 21:23:39,394 DEBUG [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(1478): Online Regions={8b7b453ce226864b66b45e0f4d67db0f=hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f., 1588230740=hbase:meta,,1.1588230740, 7e838891bcf8e31591c9f8cc2f947b1a=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.} 2023-07-11 21:23:39,394 DEBUG [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(1504): Waiting on 1588230740, 7e838891bcf8e31591c9f8cc2f947b1a, 8b7b453ce226864b66b45e0f4d67db0f 2023-07-11 21:23:39,394 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 21:23:39,394 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 21:23:39,395 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 21:23:39,395 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 21:23:39,395 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 21:23:39,396 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 21:23:39,396 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 21:23:39,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.10 KB heapSize=5.61 KB 2023-07-11 21:23:39,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/namespace/8b7b453ce226864b66b45e0f4d67db0f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:23:39,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:23:39,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 8b7b453ce226864b66b45e0f4d67db0f: 2023-07-11 21:23:39,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689110557825.8b7b453ce226864b66b45e0f4d67db0f. 2023-07-11 21:23:39,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 7e838891bcf8e31591c9f8cc2f947b1a, disabling compactions & flushes 2023-07-11 21:23:39,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:23:39,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:23:39,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. after waiting 0 ms 2023-07-11 21:23:39,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:23:39,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 7e838891bcf8e31591c9f8cc2f947b1a 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-11 21:23:39,418 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.84 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/.tmp/info/dfae73f68d50475faa520443b6f76f5f 2023-07-11 21:23:39,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=22 (bloomFilter=true), to=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/.tmp/info/0da701e033dd4ab5a58acd08239ca70c 2023-07-11 21:23:39,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/.tmp/info/0da701e033dd4ab5a58acd08239ca70c as hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/0da701e033dd4ab5a58acd08239ca70c 2023-07-11 21:23:39,447 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=264 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/.tmp/table/2dd80e5d54d34da2952ed5c4a415434c 2023-07-11 21:23:39,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/0da701e033dd4ab5a58acd08239ca70c, entries=1, sequenceid=22, filesize=5.8 K 2023-07-11 21:23:39,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for 7e838891bcf8e31591c9f8cc2f947b1a in 48ms, sequenceid=22, compaction requested=true 2023-07-11 21:23:39,454 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/132696ff8d6342ceb95efbefd13c0c33, hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/27ed6a8e7f774d7e9216c5787bd5287e, hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/c3fd3a2fe8d54d54af348848508318ca] to archive 2023-07-11 21:23:39,455 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 21:23:39,456 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/.tmp/info/dfae73f68d50475faa520443b6f76f5f as hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/info/dfae73f68d50475faa520443b6f76f5f 2023-07-11 21:23:39,459 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/132696ff8d6342ceb95efbefd13c0c33 to hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/132696ff8d6342ceb95efbefd13c0c33 2023-07-11 21:23:39,461 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/27ed6a8e7f774d7e9216c5787bd5287e to hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/27ed6a8e7f774d7e9216c5787bd5287e 2023-07-11 21:23:39,463 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/c3fd3a2fe8d54d54af348848508318ca to hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/info/c3fd3a2fe8d54d54af348848508318ca 2023-07-11 21:23:39,464 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/info/dfae73f68d50475faa520443b6f76f5f, entries=20, sequenceid=14, filesize=7.6 K 2023-07-11 21:23:39,465 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/.tmp/table/2dd80e5d54d34da2952ed5c4a415434c as hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/table/2dd80e5d54d34da2952ed5c4a415434c 2023-07-11 21:23:39,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/table/2dd80e5d54d34da2952ed5c4a415434c, entries=4, sequenceid=14, filesize=4.9 K 2023-07-11 21:23:39,474 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.10 KB/3174, heapSize ~5.33 KB/5456, currentSize=0 B/0 for 1588230740 in 78ms, sequenceid=14, compaction requested=false 2023-07-11 21:23:39,493 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-07-11 21:23:39,495 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:23:39,496 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 21:23:39,496 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 21:23:39,496 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 21:23:39,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/7e838891bcf8e31591c9f8cc2f947b1a/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2023-07-11 21:23:39,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:23:39,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 7e838891bcf8e31591c9f8cc2f947b1a: 2023-07-11 21:23:39,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1689110558634.7e838891bcf8e31591c9f8cc2f947b1a. 2023-07-11 21:23:39,594 INFO [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,46173,1689110557012; all regions closed. 2023-07-11 21:23:39,602 DEBUG [RS:0;jenkins-hbase5:46173] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/oldWALs 2023-07-11 21:23:39,602 INFO [RS:0;jenkins-hbase5:46173] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C46173%2C1689110557012.meta:.meta(num 1689110557714) 2023-07-11 21:23:39,610 DEBUG [RS:0;jenkins-hbase5:46173] wal.AbstractFSWAL(1028): Moved 2 WAL file(s) to /user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/oldWALs 2023-07-11 21:23:39,610 INFO [RS:0;jenkins-hbase5:46173] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C46173%2C1689110557012:(num 1689110619370) 2023-07-11 21:23:39,610 DEBUG [RS:0;jenkins-hbase5:46173] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:23:39,610 INFO [RS:0;jenkins-hbase5:46173] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:23:39,610 INFO [RS:0;jenkins-hbase5:46173] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 21:23:39,610 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 21:23:39,611 INFO [RS:0;jenkins-hbase5:46173] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:46173 2023-07-11 21:23:39,613 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,46173,1689110557012 2023-07-11 21:23:39,613 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:23:39,613 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:23:39,616 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,46173,1689110557012] 2023-07-11 21:23:39,616 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,46173,1689110557012; numProcessing=1 2023-07-11 21:23:39,617 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,46173,1689110557012 already deleted, retry=false 2023-07-11 21:23:39,617 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,46173,1689110557012 expired; onlineServers=0 2023-07-11 21:23:39,617 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,41779,1689110556940' ***** 2023-07-11 21:23:39,617 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 21:23:39,618 DEBUG [M:0;jenkins-hbase5:41779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6795515, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 21:23:39,618 INFO [M:0;jenkins-hbase5:41779] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,41779,1689110556940 2023-07-11 21:23:39,618 INFO [M:0;jenkins-hbase5:41779] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,41779,1689110556940; all regions closed. 2023-07-11 21:23:39,618 DEBUG [M:0;jenkins-hbase5:41779] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:23:39,618 DEBUG [M:0;jenkins-hbase5:41779] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 21:23:39,618 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 21:23:39,618 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689110557250] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689110557250,5,FailOnTimeoutGroup] 2023-07-11 21:23:39,618 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689110557251] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689110557251,5,FailOnTimeoutGroup] 2023-07-11 21:23:39,618 DEBUG [M:0;jenkins-hbase5:41779] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 21:23:39,619 INFO [M:0;jenkins-hbase5:41779] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 21:23:39,619 INFO [M:0;jenkins-hbase5:41779] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 21:23:39,619 INFO [M:0;jenkins-hbase5:41779] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-07-11 21:23:39,619 DEBUG [M:0;jenkins-hbase5:41779] master.HMaster(1512): Stopping service threads 2023-07-11 21:23:39,619 INFO [M:0;jenkins-hbase5:41779] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 21:23:39,619 ERROR [M:0;jenkins-hbase5:41779] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 21:23:39,620 INFO [M:0;jenkins-hbase5:41779] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 21:23:39,620 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 21:23:39,621 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 21:23:39,621 DEBUG [M:0;jenkins-hbase5:41779] zookeeper.ZKUtil(398): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 21:23:39,621 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:23:39,621 WARN [M:0;jenkins-hbase5:41779] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 21:23:39,621 INFO [M:0;jenkins-hbase5:41779] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 21:23:39,621 INFO [M:0;jenkins-hbase5:41779] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 21:23:39,622 DEBUG [M:0;jenkins-hbase5:41779] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 21:23:39,622 INFO [M:0;jenkins-hbase5:41779] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:23:39,622 DEBUG [M:0;jenkins-hbase5:41779] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:23:39,622 DEBUG [M:0;jenkins-hbase5:41779] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 21:23:39,622 DEBUG [M:0;jenkins-hbase5:41779] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:23:39,622 INFO [M:0;jenkins-hbase5:41779] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.88 KB heapSize=47.33 KB 2023-07-11 21:23:39,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:23:39,644 INFO [M:0;jenkins-hbase5:41779] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.88 KB at sequenceid=100 (bloomFilter=true), to=hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c145f67f6dd04ddc91eb69464da4db17 2023-07-11 21:23:39,654 INFO [M:0;jenkins-hbase5:41779] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c145f67f6dd04ddc91eb69464da4db17 2023-07-11 21:23:39,655 DEBUG [M:0;jenkins-hbase5:41779] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c145f67f6dd04ddc91eb69464da4db17 as hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c145f67f6dd04ddc91eb69464da4db17 2023-07-11 21:23:39,662 INFO [M:0;jenkins-hbase5:41779] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c145f67f6dd04ddc91eb69464da4db17 2023-07-11 21:23:39,663 INFO [M:0;jenkins-hbase5:41779] regionserver.HStore(1080): Added hdfs://localhost:40535/user/jenkins/test-data/683a3b14-bc08-654f-7fb2-32081960cf2b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c145f67f6dd04ddc91eb69464da4db17, entries=11, sequenceid=100, filesize=6.1 K 2023-07-11 21:23:39,664 INFO [M:0;jenkins-hbase5:41779] regionserver.HRegion(2948): Finished flush of dataSize ~38.88 KB/39812, heapSize ~47.31 KB/48448, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 42ms, sequenceid=100, compaction requested=false 2023-07-11 21:23:39,665 INFO [M:0;jenkins-hbase5:41779] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:23:39,665 DEBUG [M:0;jenkins-hbase5:41779] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:23:39,670 INFO [M:0;jenkins-hbase5:41779] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 21:23:39,670 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 21:23:39,670 INFO [M:0;jenkins-hbase5:41779] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:41779 2023-07-11 21:23:39,673 DEBUG [M:0;jenkins-hbase5:41779] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,41779,1689110556940 already deleted, retry=false 2023-07-11 21:23:39,716 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:23:39,716 INFO [RS:0;jenkins-hbase5:46173] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,46173,1689110557012; zookeeper connection closed. 2023-07-11 21:23:39,716 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): regionserver:46173-0x101c1e07b4f0001, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:23:39,717 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@656af290] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@656af290 2023-07-11 21:23:39,717 INFO [Listener at localhost/33141] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-11 21:23:39,816 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:23:39,816 INFO [M:0;jenkins-hbase5:41779] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,41779,1689110556940; zookeeper connection closed. 2023-07-11 21:23:39,816 DEBUG [Listener at localhost/33141-EventThread] zookeeper.ZKWatcher(600): master:41779-0x101c1e07b4f0000, quorum=127.0.0.1:54692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:23:39,817 WARN [Listener at localhost/33141] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:23:39,828 INFO [Listener at localhost/33141] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:23:39,891 WARN [BP-801722922-172.31.10.131-1689110556293 heartbeating to localhost/127.0.0.1:40535] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-801722922-172.31.10.131-1689110556293 (Datanode Uuid 62a45136-3281-4ae7-8a82-14ae81023eca) service to localhost/127.0.0.1:40535 2023-07-11 21:23:39,892 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/cluster_e43f865e-40a6-dc90-1c29-091f1d6bef49/dfs/data/data3/current/BP-801722922-172.31.10.131-1689110556293] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:23:39,893 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/cluster_e43f865e-40a6-dc90-1c29-091f1d6bef49/dfs/data/data4/current/BP-801722922-172.31.10.131-1689110556293] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:23:39,935 WARN [Listener at localhost/33141] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:23:39,983 INFO [Listener at localhost/33141] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:23:39,992 WARN [BP-801722922-172.31.10.131-1689110556293 heartbeating to localhost/127.0.0.1:40535] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:23:39,992 WARN [BP-801722922-172.31.10.131-1689110556293 heartbeating to localhost/127.0.0.1:40535] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-801722922-172.31.10.131-1689110556293 (Datanode Uuid 5ad982f7-9ef3-4e22-aab0-3996f0448558) service to localhost/127.0.0.1:40535 2023-07-11 21:23:39,994 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/cluster_e43f865e-40a6-dc90-1c29-091f1d6bef49/dfs/data/data1/current/BP-801722922-172.31.10.131-1689110556293] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:23:39,999 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/cluster_e43f865e-40a6-dc90-1c29-091f1d6bef49/dfs/data/data2/current/BP-801722922-172.31.10.131-1689110556293] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:23:40,069 INFO [Listener at localhost/33141] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:23:40,108 INFO [Listener at localhost/33141] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 21:23:40,136 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-11 21:23:40,156 INFO [Listener at localhost/33141] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=64 (was 75), OpenFileDescriptor=438 (was 468), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=399 (was 601), ProcessCount=173 (was 175), AvailableMemoryMB=3481 (was 3191) - AvailableMemoryMB LEAK? - 2023-07-11 21:23:40,170 INFO [Listener at localhost/33141] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=65, OpenFileDescriptor=438, MaxFileDescriptor=60000, SystemLoadAverage=399, ProcessCount=173, AvailableMemoryMB=3480 2023-07-11 21:23:40,170 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 21:23:40,170 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/hadoop.log.dir so I do NOT create it in target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a 2023-07-11 21:23:40,171 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d6e3c3e3-ede0-740d-5981-21ac24b35b70/hadoop.tmp.dir so I do NOT create it in target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a 2023-07-11 21:23:40,171 INFO [Listener at localhost/33141] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/cluster_b87950ca-26f6-73dd-816a-10ee8e9fd3bc, deleteOnExit=true 2023-07-11 21:23:40,171 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 21:23:40,171 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/test.cache.data in system properties and HBase conf 2023-07-11 21:23:40,171 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 21:23:40,171 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/hadoop.log.dir in system properties and HBase conf 2023-07-11 21:23:40,171 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 21:23:40,172 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 21:23:40,172 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 21:23:40,172 DEBUG [Listener at localhost/33141] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 21:23:40,172 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:23:40,172 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:23:40,173 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 21:23:40,173 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:23:40,173 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 21:23:40,173 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 21:23:40,173 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:23:40,173 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:23:40,174 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 21:23:40,174 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/nfs.dump.dir in system properties and HBase conf 2023-07-11 21:23:40,174 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/java.io.tmpdir in system properties and HBase conf 2023-07-11 21:23:40,174 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:23:40,174 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 21:23:40,175 INFO [Listener at localhost/33141] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 21:23:40,180 WARN [Listener at localhost/33141] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 21:23:40,180 WARN [Listener at localhost/33141] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 21:23:40,235 WARN [Listener at localhost/33141] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:23:40,238 INFO [Listener at localhost/33141] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:23:40,244 INFO [Listener at localhost/33141] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/java.io.tmpdir/Jetty_localhost_46095_hdfs____kpqvxw/webapp 2023-07-11 21:23:40,355 INFO [Listener at localhost/33141] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46095 2023-07-11 21:23:40,361 WARN [Listener at localhost/33141] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 21:23:40,361 WARN [Listener at localhost/33141] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 21:23:40,440 WARN [Listener at localhost/36251] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:23:40,460 WARN [Listener at localhost/36251] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:23:40,463 WARN [Listener at localhost/36251] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:23:40,464 INFO [Listener at localhost/36251] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:23:40,471 INFO [Listener at localhost/36251] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/java.io.tmpdir/Jetty_localhost_37433_datanode____.8983ft/webapp 2023-07-11 21:23:40,603 INFO [Listener at localhost/36251] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37433 2023-07-11 21:23:40,614 WARN [Listener at localhost/42679] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:23:40,651 WARN [Listener at localhost/42679] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:23:40,655 WARN [Listener at localhost/42679] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:23:40,656 INFO [Listener at localhost/42679] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:23:40,663 INFO [Listener at localhost/42679] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/java.io.tmpdir/Jetty_localhost_33071_datanode____.qx4g33/webapp 2023-07-11 21:23:40,805 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x65f6070f895998c3: Processing first storage report for DS-fa6e1d3c-2d8e-4585-90e0-ee90690b3286 from datanode ed89530d-a026-4961-8394-39b068907b63 2023-07-11 21:23:40,805 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x65f6070f895998c3: from storage DS-fa6e1d3c-2d8e-4585-90e0-ee90690b3286 node DatanodeRegistration(127.0.0.1:42995, datanodeUuid=ed89530d-a026-4961-8394-39b068907b63, infoPort=41641, infoSecurePort=0, ipcPort=42679, storageInfo=lv=-57;cid=testClusterID;nsid=1561214382;c=1689110620184), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-11 21:23:40,805 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x65f6070f895998c3: Processing first storage report for DS-27fcc451-87ed-4258-af31-d6fd12c22c4a from datanode ed89530d-a026-4961-8394-39b068907b63 2023-07-11 21:23:40,805 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x65f6070f895998c3: from storage DS-27fcc451-87ed-4258-af31-d6fd12c22c4a node DatanodeRegistration(127.0.0.1:42995, datanodeUuid=ed89530d-a026-4961-8394-39b068907b63, infoPort=41641, infoSecurePort=0, ipcPort=42679, storageInfo=lv=-57;cid=testClusterID;nsid=1561214382;c=1689110620184), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:23:40,844 INFO [Listener at localhost/42679] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33071 2023-07-11 21:23:40,882 WARN [Listener at localhost/39973] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:23:41,111 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4e7048d641e56be8: Processing first storage report for DS-1a8a0f83-c436-4bf7-9869-fd25221d04ee from datanode 467c733c-f684-4c63-a6d2-19a1d50922d1 2023-07-11 21:23:41,111 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4e7048d641e56be8: from storage DS-1a8a0f83-c436-4bf7-9869-fd25221d04ee node DatanodeRegistration(127.0.0.1:41555, datanodeUuid=467c733c-f684-4c63-a6d2-19a1d50922d1, infoPort=41957, infoSecurePort=0, ipcPort=39973, storageInfo=lv=-57;cid=testClusterID;nsid=1561214382;c=1689110620184), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:23:41,111 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4e7048d641e56be8: Processing first storage report for DS-f6dbe0f7-4afc-4670-baab-4efe4ec744e6 from datanode 467c733c-f684-4c63-a6d2-19a1d50922d1 2023-07-11 21:23:41,111 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4e7048d641e56be8: from storage DS-f6dbe0f7-4afc-4670-baab-4efe4ec744e6 node DatanodeRegistration(127.0.0.1:41555, datanodeUuid=467c733c-f684-4c63-a6d2-19a1d50922d1, infoPort=41957, infoSecurePort=0, ipcPort=39973, storageInfo=lv=-57;cid=testClusterID;nsid=1561214382;c=1689110620184), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:23:41,164 DEBUG [Listener at localhost/39973] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a 2023-07-11 21:23:41,208 INFO [Listener at localhost/39973] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/cluster_b87950ca-26f6-73dd-816a-10ee8e9fd3bc/zookeeper_0, clientPort=62565, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/cluster_b87950ca-26f6-73dd-816a-10ee8e9fd3bc/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/cluster_b87950ca-26f6-73dd-816a-10ee8e9fd3bc/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 21:23:41,209 INFO [Listener at localhost/39973] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62565 2023-07-11 21:23:41,210 INFO [Listener at localhost/39973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:23:41,211 INFO [Listener at localhost/39973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:23:41,235 INFO [Listener at localhost/39973] util.FSUtils(471): Created version file at hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c with version=8 2023-07-11 21:23:41,235 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/hbase-staging 2023-07-11 21:23:41,238 INFO [Listener at localhost/39973] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 21:23:41,238 INFO [Listener at localhost/39973] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:23:41,238 INFO [Listener at localhost/39973] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:23:41,238 INFO [Listener at localhost/39973] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:23:41,238 INFO [Listener at localhost/39973] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:23:41,238 INFO [Listener at localhost/39973] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:23:41,239 INFO [Listener at localhost/39973] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:23:41,246 INFO [Listener at localhost/39973] ipc.NettyRpcServer(120): Bind to /172.31.10.131:45467 2023-07-11 21:23:41,247 INFO [Listener at localhost/39973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:23:41,248 INFO [Listener at localhost/39973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:23:41,249 INFO [Listener at localhost/39973] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45467 connecting to ZooKeeper ensemble=127.0.0.1:62565 2023-07-11 21:23:41,264 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:454670x0, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:23:41,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45467-0x101c1e1764f0000 connected 2023-07-11 21:23:41,282 DEBUG [Listener at localhost/39973] zookeeper.ZKUtil(164): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:23:41,283 DEBUG [Listener at localhost/39973] zookeeper.ZKUtil(164): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:23:41,283 DEBUG [Listener at localhost/39973] zookeeper.ZKUtil(164): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:23:41,286 DEBUG [Listener at localhost/39973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45467 2023-07-11 21:23:41,286 DEBUG [Listener at localhost/39973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45467 2023-07-11 21:23:41,287 DEBUG [Listener at localhost/39973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45467 2023-07-11 21:23:41,287 DEBUG [Listener at localhost/39973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45467 2023-07-11 21:23:41,289 DEBUG [Listener at localhost/39973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45467 2023-07-11 21:23:41,289 INFO [Listener at localhost/39973] master.HMaster(444): hbase.rootdir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c, hbase.cluster.distributed=false 2023-07-11 21:23:41,305 INFO [Listener at localhost/39973] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 21:23:41,305 INFO [Listener at localhost/39973] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:23:41,305 INFO [Listener at localhost/39973] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:23:41,305 INFO [Listener at localhost/39973] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:23:41,305 INFO [Listener at localhost/39973] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:23:41,306 INFO [Listener at localhost/39973] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:23:41,306 INFO [Listener at localhost/39973] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:23:41,307 INFO [Listener at localhost/39973] ipc.NettyRpcServer(120): Bind to /172.31.10.131:42399 2023-07-11 21:23:41,308 INFO [Listener at localhost/39973] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 21:23:41,309 DEBUG [Listener at localhost/39973] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 21:23:41,309 INFO [Listener at localhost/39973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:23:41,310 INFO [Listener at localhost/39973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:23:41,311 INFO [Listener at localhost/39973] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42399 connecting to ZooKeeper ensemble=127.0.0.1:62565 2023-07-11 21:23:41,314 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): regionserver:423990x0, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:23:41,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42399-0x101c1e1764f0001 connected 2023-07-11 21:23:41,315 DEBUG [Listener at localhost/39973] zookeeper.ZKUtil(164): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:23:41,316 DEBUG [Listener at localhost/39973] zookeeper.ZKUtil(164): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:23:41,317 DEBUG [Listener at localhost/39973] zookeeper.ZKUtil(164): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:23:41,320 DEBUG [Listener at localhost/39973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42399 2023-07-11 21:23:41,320 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:23:41,321 DEBUG [Listener at localhost/39973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42399 2023-07-11 21:23:41,323 DEBUG [Listener at localhost/39973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42399 2023-07-11 21:23:41,325 DEBUG [Listener at localhost/39973] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42399 2023-07-11 21:23:41,325 DEBUG [Listener at localhost/39973] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42399 2023-07-11 21:23:41,327 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,45467,1689110621237 2023-07-11 21:23:41,329 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 21:23:41,330 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,45467,1689110621237 2023-07-11 21:23:41,335 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:23:41,335 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:23:41,335 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:23:41,337 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 21:23:41,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 21:23:41,338 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,45467,1689110621237 from backup master directory 2023-07-11 21:23:41,339 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,45467,1689110621237 2023-07-11 21:23:41,339 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:23:41,339 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 21:23:41,339 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,45467,1689110621237 2023-07-11 21:23:41,392 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/hbase.id with ID: 7c0d6b3c-6e89-43f7-a290-5b909ad946ad 2023-07-11 21:23:41,416 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:23:41,418 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:23:41,422 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:23:41,478 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x481ebb20 to 127.0.0.1:62565 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:23:41,518 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@441e2c7d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:23:41,518 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:23:41,519 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 21:23:41,532 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:23:41,535 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/data/master/store-tmp 2023-07-11 21:23:41,606 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:23:41,606 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 21:23:41,606 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:23:41,606 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:23:41,606 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 21:23:41,606 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:23:41,607 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:23:41,607 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:23:41,613 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/WALs/jenkins-hbase5.apache.org,45467,1689110621237 2023-07-11 21:23:41,617 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C45467%2C1689110621237, suffix=, logDir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/WALs/jenkins-hbase5.apache.org,45467,1689110621237, archiveDir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/oldWALs, maxLogs=10 2023-07-11 21:23:41,662 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41555,DS-1a8a0f83-c436-4bf7-9869-fd25221d04ee,DISK] 2023-07-11 21:23:41,676 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42995,DS-fa6e1d3c-2d8e-4585-90e0-ee90690b3286,DISK] 2023-07-11 21:23:41,688 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/WALs/jenkins-hbase5.apache.org,45467,1689110621237/jenkins-hbase5.apache.org%2C45467%2C1689110621237.1689110621617 2023-07-11 21:23:41,689 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41555,DS-1a8a0f83-c436-4bf7-9869-fd25221d04ee,DISK], DatanodeInfoWithStorage[127.0.0.1:42995,DS-fa6e1d3c-2d8e-4585-90e0-ee90690b3286,DISK]] 2023-07-11 21:23:41,689 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:23:41,689 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:23:41,689 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:23:41,689 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:23:41,693 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:23:41,695 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 21:23:41,695 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 21:23:41,696 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:23:41,697 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:23:41,699 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:23:41,703 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:23:41,708 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:23:41,709 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=844859, jitterRate=0.07429485023021698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:23:41,709 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:23:41,715 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 21:23:41,717 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 21:23:41,717 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 21:23:41,717 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 21:23:41,717 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 21:23:41,718 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-11 21:23:41,718 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 21:23:41,719 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 21:23:41,720 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 21:23:41,732 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 21:23:41,732 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 21:23:41,733 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 21:23:41,733 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 21:23:41,733 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 21:23:41,747 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:23:41,749 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 21:23:41,749 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 21:23:41,751 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 21:23:41,752 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:23:41,752 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:23:41,752 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:23:41,753 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,45467,1689110621237, sessionid=0x101c1e1764f0000, setting cluster-up flag (Was=false) 2023-07-11 21:23:41,762 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 21:23:41,763 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,45467,1689110621237 2023-07-11 21:23:41,767 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:23:41,771 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 21:23:41,773 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,45467,1689110621237 2023-07-11 21:23:41,773 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/.hbase-snapshot/.tmp 2023-07-11 21:23:41,776 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 21:23:41,776 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:23:41,776 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:23:41,777 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:23:41,777 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:23:41,777 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-07-11 21:23:41,777 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:23:41,777 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:23:41,777 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:23:41,804 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689110651804 2023-07-11 21:23:41,805 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 21:23:41,805 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 21:23:41,805 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 21:23:41,805 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 21:23:41,805 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 21:23:41,805 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 21:23:41,805 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:41,808 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 21:23:41,809 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 21:23:41,809 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 21:23:41,813 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 21:23:41,813 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 21:23:41,813 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 21:23:41,813 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 21:23:41,814 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689110621813,5,FailOnTimeoutGroup] 2023-07-11 21:23:41,814 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689110621814,5,FailOnTimeoutGroup] 2023-07-11 21:23:41,814 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:41,814 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 21:23:41,814 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:41,814 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:41,815 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:23:41,829 INFO [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(951): ClusterId : 7c0d6b3c-6e89-43f7-a290-5b909ad946ad 2023-07-11 21:23:41,838 DEBUG [RS:0;jenkins-hbase5:42399] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 21:23:41,843 DEBUG [RS:0;jenkins-hbase5:42399] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 21:23:41,843 DEBUG [RS:0;jenkins-hbase5:42399] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 21:23:41,847 DEBUG [RS:0;jenkins-hbase5:42399] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 21:23:41,848 DEBUG [RS:0;jenkins-hbase5:42399] zookeeper.ReadOnlyZKClient(139): Connect 0x6f13f6fb to 127.0.0.1:62565 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:23:41,857 DEBUG [RS:0;jenkins-hbase5:42399] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61d41569, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:23:41,858 DEBUG [RS:0;jenkins-hbase5:42399] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65eb9d8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 21:23:41,859 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 21:23:41,865 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 21:23:41,865 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c 2023-07-11 21:23:41,869 DEBUG [RS:0;jenkins-hbase5:42399] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:42399 2023-07-11 21:23:41,869 INFO [RS:0;jenkins-hbase5:42399] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 21:23:41,869 INFO [RS:0;jenkins-hbase5:42399] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 21:23:41,869 DEBUG [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 21:23:41,870 INFO [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,45467,1689110621237 with isa=jenkins-hbase5.apache.org/172.31.10.131:42399, startcode=1689110621305 2023-07-11 21:23:41,870 DEBUG [RS:0;jenkins-hbase5:42399] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 21:23:41,879 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:52619, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 21:23:41,883 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45467] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:23:41,884 DEBUG [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c 2023-07-11 21:23:41,884 DEBUG [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36251 2023-07-11 21:23:41,884 DEBUG [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 21:23:41,885 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:23:41,886 DEBUG [RS:0;jenkins-hbase5:42399] zookeeper.ZKUtil(162): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:23:41,886 WARN [RS:0;jenkins-hbase5:42399] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:23:41,886 INFO [RS:0;jenkins-hbase5:42399] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:23:41,886 DEBUG [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:23:41,903 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,42399,1689110621305] 2023-07-11 21:23:41,916 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:23:41,919 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 21:23:41,921 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/info 2023-07-11 21:23:41,921 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 21:23:41,922 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:23:41,923 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 21:23:41,925 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:23:41,925 DEBUG [RS:0;jenkins-hbase5:42399] zookeeper.ZKUtil(162): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:23:41,925 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 21:23:41,933 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:23:41,933 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 21:23:41,933 DEBUG [RS:0;jenkins-hbase5:42399] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 21:23:41,934 INFO [RS:0;jenkins-hbase5:42399] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 21:23:41,936 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/table 2023-07-11 21:23:41,937 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 21:23:41,938 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:23:41,944 INFO [RS:0;jenkins-hbase5:42399] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 21:23:41,945 INFO [RS:0;jenkins-hbase5:42399] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 21:23:41,945 INFO [RS:0;jenkins-hbase5:42399] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:41,945 INFO [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 21:23:41,946 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740 2023-07-11 21:23:41,946 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740 2023-07-11 21:23:41,947 INFO [RS:0;jenkins-hbase5:42399] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:41,947 DEBUG [RS:0;jenkins-hbase5:42399] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:23:41,947 DEBUG [RS:0;jenkins-hbase5:42399] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:23:41,947 DEBUG [RS:0;jenkins-hbase5:42399] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:23:41,948 DEBUG [RS:0;jenkins-hbase5:42399] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:23:41,948 DEBUG [RS:0;jenkins-hbase5:42399] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:23:41,948 DEBUG [RS:0;jenkins-hbase5:42399] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:23:41,948 DEBUG [RS:0;jenkins-hbase5:42399] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:23:41,948 DEBUG [RS:0;jenkins-hbase5:42399] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:23:41,948 DEBUG [RS:0;jenkins-hbase5:42399] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:23:41,948 DEBUG [RS:0;jenkins-hbase5:42399] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:23:41,950 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-11 21:23:41,954 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 21:23:41,963 INFO [RS:0;jenkins-hbase5:42399] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:41,963 INFO [RS:0;jenkins-hbase5:42399] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:41,963 INFO [RS:0;jenkins-hbase5:42399] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:41,968 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:23:41,969 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=689148, jitterRate=-0.12370410561561584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-11 21:23:41,969 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 21:23:41,969 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 21:23:41,969 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 21:23:41,969 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 21:23:41,969 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 21:23:41,969 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 21:23:41,969 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 21:23:41,969 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 21:23:41,972 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 21:23:41,972 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 21:23:41,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 21:23:41,975 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 21:23:41,983 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 21:23:41,986 INFO [RS:0;jenkins-hbase5:42399] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 21:23:41,987 INFO [RS:0;jenkins-hbase5:42399] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,42399,1689110621305-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:42,004 INFO [RS:0;jenkins-hbase5:42399] regionserver.Replication(203): jenkins-hbase5.apache.org,42399,1689110621305 started 2023-07-11 21:23:42,004 INFO [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,42399,1689110621305, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:42399, sessionid=0x101c1e1764f0001 2023-07-11 21:23:42,004 DEBUG [RS:0;jenkins-hbase5:42399] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 21:23:42,004 DEBUG [RS:0;jenkins-hbase5:42399] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:23:42,004 DEBUG [RS:0;jenkins-hbase5:42399] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,42399,1689110621305' 2023-07-11 21:23:42,004 DEBUG [RS:0;jenkins-hbase5:42399] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:23:42,005 DEBUG [RS:0;jenkins-hbase5:42399] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:23:42,005 DEBUG [RS:0;jenkins-hbase5:42399] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 21:23:42,005 DEBUG [RS:0;jenkins-hbase5:42399] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 21:23:42,005 DEBUG [RS:0;jenkins-hbase5:42399] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:23:42,005 DEBUG [RS:0;jenkins-hbase5:42399] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,42399,1689110621305' 2023-07-11 21:23:42,005 DEBUG [RS:0;jenkins-hbase5:42399] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:23:42,006 DEBUG [RS:0;jenkins-hbase5:42399] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:23:42,006 DEBUG [RS:0;jenkins-hbase5:42399] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 21:23:42,006 INFO [RS:0;jenkins-hbase5:42399] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 21:23:42,006 INFO [RS:0;jenkins-hbase5:42399] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 21:23:42,109 INFO [RS:0;jenkins-hbase5:42399] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C42399%2C1689110621305, suffix=, logDir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305, archiveDir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/oldWALs, maxLogs=32 2023-07-11 21:23:42,133 DEBUG [jenkins-hbase5:45467] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-11 21:23:42,139 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,42399,1689110621305, state=OPENING 2023-07-11 21:23:42,140 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41555,DS-1a8a0f83-c436-4bf7-9869-fd25221d04ee,DISK] 2023-07-11 21:23:42,140 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42995,DS-fa6e1d3c-2d8e-4585-90e0-ee90690b3286,DISK] 2023-07-11 21:23:42,142 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 21:23:42,144 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:23:42,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42399,1689110621305}] 2023-07-11 21:23:42,144 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 21:23:42,149 INFO [RS:0;jenkins-hbase5:42399] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305/jenkins-hbase5.apache.org%2C42399%2C1689110621305.1689110622110 2023-07-11 21:23:42,150 DEBUG [RS:0;jenkins-hbase5:42399] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41555,DS-1a8a0f83-c436-4bf7-9869-fd25221d04ee,DISK], DatanodeInfoWithStorage[127.0.0.1:42995,DS-fa6e1d3c-2d8e-4585-90e0-ee90690b3286,DISK]] 2023-07-11 21:23:42,303 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:23:42,303 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:23:42,305 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:23:42,309 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 21:23:42,309 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:23:42,311 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C42399%2C1689110621305.meta, suffix=.meta, logDir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305, archiveDir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/oldWALs, maxLogs=32 2023-07-11 21:23:42,326 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41555,DS-1a8a0f83-c436-4bf7-9869-fd25221d04ee,DISK] 2023-07-11 21:23:42,327 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42995,DS-fa6e1d3c-2d8e-4585-90e0-ee90690b3286,DISK] 2023-07-11 21:23:42,335 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305/jenkins-hbase5.apache.org%2C42399%2C1689110621305.meta.1689110622312.meta 2023-07-11 21:23:42,335 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41555,DS-1a8a0f83-c436-4bf7-9869-fd25221d04ee,DISK], DatanodeInfoWithStorage[127.0.0.1:42995,DS-fa6e1d3c-2d8e-4585-90e0-ee90690b3286,DISK]] 2023-07-11 21:23:42,335 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:23:42,336 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 21:23:42,336 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 21:23:42,336 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 21:23:42,336 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 21:23:42,336 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:23:42,336 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 21:23:42,336 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 21:23:42,339 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 21:23:42,341 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/info 2023-07-11 21:23:42,341 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/info 2023-07-11 21:23:42,341 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 21:23:42,342 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:23:42,342 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 21:23:42,343 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:23:42,343 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:23:42,344 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 21:23:42,344 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:23:42,345 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 21:23:42,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/table 2023-07-11 21:23:42,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/table 2023-07-11 21:23:42,346 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 21:23:42,347 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:23:42,348 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740 2023-07-11 21:23:42,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740 2023-07-11 21:23:42,353 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-11 21:23:42,354 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 21:23:42,355 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=699778, jitterRate=-0.1101873368024826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-11 21:23:42,355 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 21:23:42,356 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689110622303 2023-07-11 21:23:42,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 21:23:42,363 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 21:23:42,364 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,42399,1689110621305, state=OPEN 2023-07-11 21:23:42,367 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 21:23:42,367 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 21:23:42,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 21:23:42,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42399,1689110621305 in 223 msec 2023-07-11 21:23:42,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 21:23:42,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 397 msec 2023-07-11 21:23:42,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 598 msec 2023-07-11 21:23:42,374 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689110622374, completionTime=-1 2023-07-11 21:23:42,374 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-11 21:23:42,374 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 21:23:42,377 DEBUG [hconnection-0x20eee235-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:23:42,379 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:23:42,380 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-11 21:23:42,380 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689110682380 2023-07-11 21:23:42,380 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689110742380 2023-07-11 21:23:42,380 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 6 msec 2023-07-11 21:23:42,386 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,45467,1689110621237-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:42,386 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,45467,1689110621237-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:42,386 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,45467,1689110621237-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:42,386 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:45467, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:42,386 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 21:23:42,386 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 21:23:42,387 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:23:42,388 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 21:23:42,388 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 21:23:42,389 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:23:42,391 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:23:42,399 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/.tmp/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa 2023-07-11 21:23:42,400 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/.tmp/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa empty. 2023-07-11 21:23:42,400 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/.tmp/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa 2023-07-11 21:23:42,401 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 21:23:42,429 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 21:23:42,430 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1242f002de3271c68d62a7e848a42bfa, NAME => 'hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/.tmp 2023-07-11 21:23:42,440 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:23:42,441 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 1242f002de3271c68d62a7e848a42bfa, disabling compactions & flushes 2023-07-11 21:23:42,441 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. 2023-07-11 21:23:42,441 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. 2023-07-11 21:23:42,441 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. after waiting 0 ms 2023-07-11 21:23:42,441 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. 2023-07-11 21:23:42,441 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. 2023-07-11 21:23:42,441 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 1242f002de3271c68d62a7e848a42bfa: 2023-07-11 21:23:42,444 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:23:42,446 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689110622446"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689110622446"}]},"ts":"1689110622446"} 2023-07-11 21:23:42,449 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 21:23:42,450 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:23:42,451 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110622451"}]},"ts":"1689110622451"} 2023-07-11 21:23:42,452 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 21:23:42,461 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1242f002de3271c68d62a7e848a42bfa, ASSIGN}] 2023-07-11 21:23:42,463 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1242f002de3271c68d62a7e848a42bfa, ASSIGN 2023-07-11 21:23:42,464 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1242f002de3271c68d62a7e848a42bfa, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42399,1689110621305; forceNewPlan=false, retain=false 2023-07-11 21:23:42,615 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1242f002de3271c68d62a7e848a42bfa, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:23:42,615 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689110622615"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689110622615"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689110622615"}]},"ts":"1689110622615"} 2023-07-11 21:23:42,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1242f002de3271c68d62a7e848a42bfa, server=jenkins-hbase5.apache.org,42399,1689110621305}] 2023-07-11 21:23:42,777 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. 2023-07-11 21:23:42,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1242f002de3271c68d62a7e848a42bfa, NAME => 'hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:23:42,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1242f002de3271c68d62a7e848a42bfa 2023-07-11 21:23:42,778 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:23:42,778 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1242f002de3271c68d62a7e848a42bfa 2023-07-11 21:23:42,778 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1242f002de3271c68d62a7e848a42bfa 2023-07-11 21:23:42,779 INFO [StoreOpener-1242f002de3271c68d62a7e848a42bfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1242f002de3271c68d62a7e848a42bfa 2023-07-11 21:23:42,781 DEBUG [StoreOpener-1242f002de3271c68d62a7e848a42bfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa/info 2023-07-11 21:23:42,781 DEBUG [StoreOpener-1242f002de3271c68d62a7e848a42bfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa/info 2023-07-11 21:23:42,781 INFO [StoreOpener-1242f002de3271c68d62a7e848a42bfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1242f002de3271c68d62a7e848a42bfa columnFamilyName info 2023-07-11 21:23:42,782 INFO [StoreOpener-1242f002de3271c68d62a7e848a42bfa-1] regionserver.HStore(310): Store=1242f002de3271c68d62a7e848a42bfa/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:23:42,782 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa 2023-07-11 21:23:42,784 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa 2023-07-11 21:23:42,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1242f002de3271c68d62a7e848a42bfa 2023-07-11 21:23:42,789 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:23:42,789 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1242f002de3271c68d62a7e848a42bfa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=822748, jitterRate=0.04617856442928314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:23:42,789 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1242f002de3271c68d62a7e848a42bfa: 2023-07-11 21:23:42,790 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa., pid=6, masterSystemTime=1689110622770 2023-07-11 21:23:42,801 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. 2023-07-11 21:23:42,801 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. 2023-07-11 21:23:42,802 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1242f002de3271c68d62a7e848a42bfa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:23:42,803 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689110622802"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689110622802"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689110622802"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689110622802"}]},"ts":"1689110622802"} 2023-07-11 21:23:42,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 21:23:42,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1242f002de3271c68d62a7e848a42bfa, server=jenkins-hbase5.apache.org,42399,1689110621305 in 187 msec 2023-07-11 21:23:42,811 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 21:23:42,811 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1242f002de3271c68d62a7e848a42bfa, ASSIGN in 347 msec 2023-07-11 21:23:42,812 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:23:42,812 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110622812"}]},"ts":"1689110622812"} 2023-07-11 21:23:42,814 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 21:23:42,816 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:23:42,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 429 msec 2023-07-11 21:23:42,889 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 21:23:42,890 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:23:42,891 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:23:42,895 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 21:23:42,904 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:23:42,907 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-07-11 21:23:42,917 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 21:23:42,925 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:23:42,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-11 21:23:42,943 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 21:23:42,945 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 21:23:42,945 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.606sec 2023-07-11 21:23:42,945 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 21:23:42,945 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 21:23:42,946 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 21:23:42,946 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,45467,1689110621237-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 21:23:42,946 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,45467,1689110621237-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 21:23:42,948 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 21:23:43,034 DEBUG [Listener at localhost/39973] zookeeper.ReadOnlyZKClient(139): Connect 0x77cf6fa7 to 127.0.0.1:62565 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:23:43,040 DEBUG [Listener at localhost/39973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70e3be5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:23:43,042 DEBUG [hconnection-0x386c53e6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:23:43,044 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:23:43,047 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,45467,1689110621237 2023-07-11 21:23:43,047 INFO [Listener at localhost/39973] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:23:43,052 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-11 21:23:43,052 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:23:43,053 INFO [Listener at localhost/39973] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-11 21:23:43,055 DEBUG [Listener at localhost/39973] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 21:23:43,059 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 21:23:43,061 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45467] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-07-11 21:23:43,061 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45467] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-07-11 21:23:43,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45467] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:23:43,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45467] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRolling 2023-07-11 21:23:43,066 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:23:43,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45467] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRolling" procId is: 9 2023-07-11 21:23:43,068 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:23:43,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45467] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:23:43,072 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/.tmp/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:23:43,073 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/.tmp/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5 empty. 2023-07-11 21:23:43,074 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/.tmp/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:23:43,074 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRolling regions 2023-07-11 21:23:43,111 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/.tmp/data/default/TestLogRolling-testLogRolling/.tabledesc/.tableinfo.0000000001 2023-07-11 21:23:43,112 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => dcc7bf416a91a6a8f4c44c144f7973d5, NAME => 'TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/.tmp 2023-07-11 21:23:43,132 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:23:43,133 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1604): Closing dcc7bf416a91a6a8f4c44c144f7973d5, disabling compactions & flushes 2023-07-11 21:23:43,133 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:23:43,133 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:23:43,133 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. after waiting 0 ms 2023-07-11 21:23:43,133 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:23:43,133 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:23:43,133 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1558): Region close journal for dcc7bf416a91a6a8f4c44c144f7973d5: 2023-07-11 21:23:43,136 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:23:43,139 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689110623138"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689110623138"}]},"ts":"1689110623138"} 2023-07-11 21:23:43,141 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 21:23:43,144 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:23:43,145 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110623145"}]},"ts":"1689110623145"} 2023-07-11 21:23:43,147 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLING in hbase:meta 2023-07-11 21:23:43,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=dcc7bf416a91a6a8f4c44c144f7973d5, ASSIGN}] 2023-07-11 21:23:43,154 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=dcc7bf416a91a6a8f4c44c144f7973d5, ASSIGN 2023-07-11 21:23:43,155 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=dcc7bf416a91a6a8f4c44c144f7973d5, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42399,1689110621305; forceNewPlan=false, retain=false 2023-07-11 21:23:43,306 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=dcc7bf416a91a6a8f4c44c144f7973d5, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:23:43,306 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689110623306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689110623306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689110623306"}]},"ts":"1689110623306"} 2023-07-11 21:23:43,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure dcc7bf416a91a6a8f4c44c144f7973d5, server=jenkins-hbase5.apache.org,42399,1689110621305}] 2023-07-11 21:23:43,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:23:43,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dcc7bf416a91a6a8f4c44c144f7973d5, NAME => 'TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:23:43,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:23:43,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:23:43,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:23:43,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:23:43,471 INFO [StoreOpener-dcc7bf416a91a6a8f4c44c144f7973d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:23:43,473 DEBUG [StoreOpener-dcc7bf416a91a6a8f4c44c144f7973d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info 2023-07-11 21:23:43,473 DEBUG [StoreOpener-dcc7bf416a91a6a8f4c44c144f7973d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info 2023-07-11 21:23:43,473 INFO [StoreOpener-dcc7bf416a91a6a8f4c44c144f7973d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dcc7bf416a91a6a8f4c44c144f7973d5 columnFamilyName info 2023-07-11 21:23:43,474 INFO [StoreOpener-dcc7bf416a91a6a8f4c44c144f7973d5-1] regionserver.HStore(310): Store=dcc7bf416a91a6a8f4c44c144f7973d5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:23:43,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:23:43,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:23:43,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:23:43,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:23:43,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened dcc7bf416a91a6a8f4c44c144f7973d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=723550, jitterRate=-0.07995912432670593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:23:43,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for dcc7bf416a91a6a8f4c44c144f7973d5: 2023-07-11 21:23:43,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5., pid=11, masterSystemTime=1689110623465 2023-07-11 21:23:43,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:23:43,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:23:43,484 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=dcc7bf416a91a6a8f4c44c144f7973d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:23:43,484 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689110623484"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689110623484"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689110623484"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689110623484"}]},"ts":"1689110623484"} 2023-07-11 21:23:43,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-11 21:23:43,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure dcc7bf416a91a6a8f4c44c144f7973d5, server=jenkins-hbase5.apache.org,42399,1689110621305 in 178 msec 2023-07-11 21:23:43,491 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-11 21:23:43,491 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=dcc7bf416a91a6a8f4c44c144f7973d5, ASSIGN in 337 msec 2023-07-11 21:23:43,493 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:23:43,493 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110623493"}]},"ts":"1689110623493"} 2023-07-11 21:23:43,495 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLED in hbase:meta 2023-07-11 21:23:43,497 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:23:43,499 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRolling in 436 msec 2023-07-11 21:23:44,940 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-11 21:23:47,934 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 21:23:47,935 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 21:23:47,935 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRolling' 2023-07-11 21:23:51,418 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:23:51,418 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 21:23:53,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45467] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 21:23:53,070 INFO [Listener at localhost/39973] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRolling, procId: 9 completed 2023-07-11 21:23:53,073 DEBUG [Listener at localhost/39973] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRolling 2023-07-11 21:23:53,073 DEBUG [Listener at localhost/39973] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:23:53,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:23:53,090 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing dcc7bf416a91a6a8f4c44c144f7973d5 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-11 21:23:53,107 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=12 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/5235e3c9bcca41dfa38f523f69eaba8c 2023-07-11 21:23:53,131 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/5235e3c9bcca41dfa38f523f69eaba8c as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/5235e3c9bcca41dfa38f523f69eaba8c 2023-07-11 21:23:53,134 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=dcc7bf416a91a6a8f4c44c144f7973d5, server=jenkins-hbase5.apache.org,42399,1689110621305 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:23:53,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] ipc.CallRunner(144): callId: 38 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.10.131:40308 deadline: 1689110643134, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=dcc7bf416a91a6a8f4c44c144f7973d5, server=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:23:53,139 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/5235e3c9bcca41dfa38f523f69eaba8c, entries=8, sequenceid=12, filesize=13.0 K 2023-07-11 21:23:53,141 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for dcc7bf416a91a6a8f4c44c144f7973d5 in 51ms, sequenceid=12, compaction requested=false 2023-07-11 21:23:53,142 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for dcc7bf416a91a6a8f4c44c144f7973d5: 2023-07-11 21:24:03,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:03,154 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing dcc7bf416a91a6a8f4c44c144f7973d5 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-11 21:24:03,175 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=37 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/08a16c44e1fc4e5ab843a43336421ba3 2023-07-11 21:24:03,184 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/08a16c44e1fc4e5ab843a43336421ba3 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/08a16c44e1fc4e5ab843a43336421ba3 2023-07-11 21:24:03,191 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/08a16c44e1fc4e5ab843a43336421ba3, entries=22, sequenceid=37, filesize=27.4 K 2023-07-11 21:24:03,194 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for dcc7bf416a91a6a8f4c44c144f7973d5 in 40ms, sequenceid=37, compaction requested=false 2023-07-11 21:24:03,194 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for dcc7bf416a91a6a8f4c44c144f7973d5: 2023-07-11 21:24:03,194 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=40.3 K, sizeToCheck=16.0 K 2023-07-11 21:24:03,195 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-11 21:24:03,196 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/08a16c44e1fc4e5ab843a43336421ba3 because midkey is the same as first or last row 2023-07-11 21:24:05,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:05,167 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing dcc7bf416a91a6a8f4c44c144f7973d5 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-11 21:24:05,189 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=48 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/456e4502720c4478b88b0ca031db386c 2023-07-11 21:24:05,197 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/456e4502720c4478b88b0ca031db386c as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/456e4502720c4478b88b0ca031db386c 2023-07-11 21:24:05,204 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/456e4502720c4478b88b0ca031db386c, entries=8, sequenceid=48, filesize=13.0 K 2023-07-11 21:24:05,204 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=dcc7bf416a91a6a8f4c44c144f7973d5, server=jenkins-hbase5.apache.org,42399,1689110621305 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:24:05,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] ipc.CallRunner(144): callId: 70 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.10.131:40308 deadline: 1689110655204, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=dcc7bf416a91a6a8f4c44c144f7973d5, server=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:24:05,205 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for dcc7bf416a91a6a8f4c44c144f7973d5 in 38ms, sequenceid=48, compaction requested=true 2023-07-11 21:24:05,205 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for dcc7bf416a91a6a8f4c44c144f7973d5: 2023-07-11 21:24:05,205 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=53.3 K, sizeToCheck=16.0 K 2023-07-11 21:24:05,205 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-11 21:24:05,205 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/08a16c44e1fc4e5ab843a43336421ba3 because midkey is the same as first or last row 2023-07-11 21:24:05,206 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:05,206 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 21:24:05,208 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 54576 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 21:24:05,208 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1912): dcc7bf416a91a6a8f4c44c144f7973d5/info is initiating minor compaction (all files) 2023-07-11 21:24:05,209 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of dcc7bf416a91a6a8f4c44c144f7973d5/info in TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:24:05,209 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/5235e3c9bcca41dfa38f523f69eaba8c, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/08a16c44e1fc4e5ab843a43336421ba3, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/456e4502720c4478b88b0ca031db386c] into tmpdir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp, totalSize=53.3 K 2023-07-11 21:24:05,209 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 5235e3c9bcca41dfa38f523f69eaba8c, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1689110633076 2023-07-11 21:24:05,210 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 08a16c44e1fc4e5ab843a43336421ba3, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=37, earliestPutTs=1689110633091 2023-07-11 21:24:05,210 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 456e4502720c4478b88b0ca031db386c, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1689110643155 2023-07-11 21:24:05,226 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] throttle.PressureAwareThroughputController(145): dcc7bf416a91a6a8f4c44c144f7973d5#info#compaction#18 average throughput is 12.70 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 21:24:05,246 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/bbc9b3e5fcdf44b9ac7edc6b2d0bbaf1 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/bbc9b3e5fcdf44b9ac7edc6b2d0bbaf1 2023-07-11 21:24:05,252 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in dcc7bf416a91a6a8f4c44c144f7973d5/info of dcc7bf416a91a6a8f4c44c144f7973d5 into bbc9b3e5fcdf44b9ac7edc6b2d0bbaf1(size=43.9 K), total size for store is 43.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 21:24:05,253 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for dcc7bf416a91a6a8f4c44c144f7973d5: 2023-07-11 21:24:05,253 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5., storeName=dcc7bf416a91a6a8f4c44c144f7973d5/info, priority=13, startTime=1689110645206; duration=0sec 2023-07-11 21:24:05,254 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=43.9 K, sizeToCheck=16.0 K 2023-07-11 21:24:05,254 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-11 21:24:05,254 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.StoreUtils(129): cannot split hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/bbc9b3e5fcdf44b9ac7edc6b2d0bbaf1 because midkey is the same as first or last row 2023-07-11 21:24:05,254 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:15,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:15,259 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing dcc7bf416a91a6a8f4c44c144f7973d5 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-11 21:24:15,273 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=74 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/6c54150d2cec4fce9966a1a1dfd03c4a 2023-07-11 21:24:15,279 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/6c54150d2cec4fce9966a1a1dfd03c4a as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/6c54150d2cec4fce9966a1a1dfd03c4a 2023-07-11 21:24:15,285 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/6c54150d2cec4fce9966a1a1dfd03c4a, entries=22, sequenceid=74, filesize=27.4 K 2023-07-11 21:24:15,286 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=4.11 KB/4204 for dcc7bf416a91a6a8f4c44c144f7973d5 in 27ms, sequenceid=74, compaction requested=false 2023-07-11 21:24:15,286 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for dcc7bf416a91a6a8f4c44c144f7973d5: 2023-07-11 21:24:15,286 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=71.3 K, sizeToCheck=16.0 K 2023-07-11 21:24:15,286 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-11 21:24:15,286 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/bbc9b3e5fcdf44b9ac7edc6b2d0bbaf1 because midkey is the same as first or last row 2023-07-11 21:24:17,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:17,271 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing dcc7bf416a91a6a8f4c44c144f7973d5 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-11 21:24:17,283 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=85 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/424ae8395a2144789257142b1bc8b312 2023-07-11 21:24:17,290 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/424ae8395a2144789257142b1bc8b312 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/424ae8395a2144789257142b1bc8b312 2023-07-11 21:24:17,297 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/424ae8395a2144789257142b1bc8b312, entries=8, sequenceid=85, filesize=13.0 K 2023-07-11 21:24:17,298 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=20.53 KB/21020 for dcc7bf416a91a6a8f4c44c144f7973d5 in 28ms, sequenceid=85, compaction requested=true 2023-07-11 21:24:17,298 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for dcc7bf416a91a6a8f4c44c144f7973d5: 2023-07-11 21:24:17,298 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=84.3 K, sizeToCheck=16.0 K 2023-07-11 21:24:17,298 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-11 21:24:17,298 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/bbc9b3e5fcdf44b9ac7edc6b2d0bbaf1 because midkey is the same as first or last row 2023-07-11 21:24:17,298 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:17,298 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 21:24:17,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:17,300 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing dcc7bf416a91a6a8f4c44c144f7973d5 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-11 21:24:17,300 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 86295 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 21:24:17,300 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1912): dcc7bf416a91a6a8f4c44c144f7973d5/info is initiating minor compaction (all files) 2023-07-11 21:24:17,300 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of dcc7bf416a91a6a8f4c44c144f7973d5/info in TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:24:17,300 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/bbc9b3e5fcdf44b9ac7edc6b2d0bbaf1, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/6c54150d2cec4fce9966a1a1dfd03c4a, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/424ae8395a2144789257142b1bc8b312] into tmpdir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp, totalSize=84.3 K 2023-07-11 21:24:17,301 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting bbc9b3e5fcdf44b9ac7edc6b2d0bbaf1, keycount=38, bloomtype=ROW, size=43.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1689110633076 2023-07-11 21:24:17,302 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 6c54150d2cec4fce9966a1a1dfd03c4a, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=74, earliestPutTs=1689110645168 2023-07-11 21:24:17,302 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 424ae8395a2144789257142b1bc8b312, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=85, earliestPutTs=1689110655260 2023-07-11 21:24:17,332 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=110 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/40ec94b253784fcf9e26f3c92c37d785 2023-07-11 21:24:17,338 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] throttle.PressureAwareThroughputController(145): dcc7bf416a91a6a8f4c44c144f7973d5#info#compaction#22 average throughput is 34.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 21:24:17,353 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/40ec94b253784fcf9e26f3c92c37d785 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/40ec94b253784fcf9e26f3c92c37d785 2023-07-11 21:24:17,368 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/40ec94b253784fcf9e26f3c92c37d785, entries=22, sequenceid=110, filesize=27.4 K 2023-07-11 21:24:17,369 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=6.16 KB/6306 for dcc7bf416a91a6a8f4c44c144f7973d5 in 69ms, sequenceid=110, compaction requested=false 2023-07-11 21:24:17,369 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for dcc7bf416a91a6a8f4c44c144f7973d5: 2023-07-11 21:24:17,370 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=111.6 K, sizeToCheck=16.0 K 2023-07-11 21:24:17,370 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-11 21:24:17,370 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/bbc9b3e5fcdf44b9ac7edc6b2d0bbaf1 because midkey is the same as first or last row 2023-07-11 21:24:17,773 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/4850d756443643b5950f106049c4b3f9 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4850d756443643b5950f106049c4b3f9 2023-07-11 21:24:17,790 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in dcc7bf416a91a6a8f4c44c144f7973d5/info of dcc7bf416a91a6a8f4c44c144f7973d5 into 4850d756443643b5950f106049c4b3f9(size=75.0 K), total size for store is 102.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 21:24:17,790 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for dcc7bf416a91a6a8f4c44c144f7973d5: 2023-07-11 21:24:17,790 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5., storeName=dcc7bf416a91a6a8f4c44c144f7973d5/info, priority=13, startTime=1689110657298; duration=0sec 2023-07-11 21:24:17,790 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=102.4 K, sizeToCheck=16.0 K 2023-07-11 21:24:17,790 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-11 21:24:17,792 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit(227): Splitting TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5., compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:17,792 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:17,793 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45467] assignment.AssignmentManager(1140): Split request from jenkins-hbase5.apache.org,42399,1689110621305, parent={ENCODED => dcc7bf416a91a6a8f4c44c144f7973d5, NAME => 'TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.', STARTKEY => '', ENDKEY => ''} splitKey=row0064 2023-07-11 21:24:17,803 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45467] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:24:17,812 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45467] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=dcc7bf416a91a6a8f4c44c144f7973d5, daughterA=fbfa6f3489084a38f3c6c6a7505bfc40, daughterB=e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:17,813 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=dcc7bf416a91a6a8f4c44c144f7973d5, daughterA=fbfa6f3489084a38f3c6c6a7505bfc40, daughterB=e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:17,813 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=dcc7bf416a91a6a8f4c44c144f7973d5, daughterA=fbfa6f3489084a38f3c6c6a7505bfc40, daughterB=e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:17,814 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=dcc7bf416a91a6a8f4c44c144f7973d5, daughterA=fbfa6f3489084a38f3c6c6a7505bfc40, daughterB=e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:17,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=dcc7bf416a91a6a8f4c44c144f7973d5, UNASSIGN}] 2023-07-11 21:24:17,827 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=dcc7bf416a91a6a8f4c44c144f7973d5, UNASSIGN 2023-07-11 21:24:17,829 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=dcc7bf416a91a6a8f4c44c144f7973d5, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:24:17,830 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689110657829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689110657829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689110657829"}]},"ts":"1689110657829"} 2023-07-11 21:24:17,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; CloseRegionProcedure dcc7bf416a91a6a8f4c44c144f7973d5, server=jenkins-hbase5.apache.org,42399,1689110621305}] 2023-07-11 21:24:17,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:17,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing dcc7bf416a91a6a8f4c44c144f7973d5, disabling compactions & flushes 2023-07-11 21:24:17,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:24:17,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:24:17,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. after waiting 0 ms 2023-07-11 21:24:17,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:24:17,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing dcc7bf416a91a6a8f4c44c144f7973d5 1/1 column families, dataSize=6.16 KB heapSize=6.86 KB 2023-07-11 21:24:18,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=6.16 KB at sequenceid=120 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/4d58d4ac63df46ce966ffddcc85ac5ac 2023-07-11 21:24:18,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.tmp/info/4d58d4ac63df46ce966ffddcc85ac5ac as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4d58d4ac63df46ce966ffddcc85ac5ac 2023-07-11 21:24:18,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4d58d4ac63df46ce966ffddcc85ac5ac, entries=6, sequenceid=120, filesize=10.9 K 2023-07-11 21:24:18,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~6.16 KB/6306, heapSize ~6.84 KB/7008, currentSize=0 B/0 for dcc7bf416a91a6a8f4c44c144f7973d5 in 452ms, sequenceid=120, compaction requested=true 2023-07-11 21:24:18,457 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/5235e3c9bcca41dfa38f523f69eaba8c, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/08a16c44e1fc4e5ab843a43336421ba3, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/bbc9b3e5fcdf44b9ac7edc6b2d0bbaf1, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/456e4502720c4478b88b0ca031db386c, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/6c54150d2cec4fce9966a1a1dfd03c4a, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/424ae8395a2144789257142b1bc8b312] to archive 2023-07-11 21:24:18,458 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 21:24:18,460 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/5235e3c9bcca41dfa38f523f69eaba8c to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/5235e3c9bcca41dfa38f523f69eaba8c 2023-07-11 21:24:18,462 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/08a16c44e1fc4e5ab843a43336421ba3 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/08a16c44e1fc4e5ab843a43336421ba3 2023-07-11 21:24:18,464 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/bbc9b3e5fcdf44b9ac7edc6b2d0bbaf1 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/bbc9b3e5fcdf44b9ac7edc6b2d0bbaf1 2023-07-11 21:24:18,466 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/456e4502720c4478b88b0ca031db386c to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/456e4502720c4478b88b0ca031db386c 2023-07-11 21:24:18,467 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/6c54150d2cec4fce9966a1a1dfd03c4a to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/6c54150d2cec4fce9966a1a1dfd03c4a 2023-07-11 21:24:18,469 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/424ae8395a2144789257142b1bc8b312 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/424ae8395a2144789257142b1bc8b312 2023-07-11 21:24:18,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/recovered.edits/123.seqid, newMaxSeqId=123, maxSeqId=1 2023-07-11 21:24:18,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. 2023-07-11 21:24:18,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for dcc7bf416a91a6a8f4c44c144f7973d5: 2023-07-11 21:24:18,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:18,479 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=dcc7bf416a91a6a8f4c44c144f7973d5, regionState=CLOSED 2023-07-11 21:24:18,480 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689110658479"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689110658479"}]},"ts":"1689110658479"} 2023-07-11 21:24:18,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-11 21:24:18,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; CloseRegionProcedure dcc7bf416a91a6a8f4c44c144f7973d5, server=jenkins-hbase5.apache.org,42399,1689110621305 in 645 msec 2023-07-11 21:24:18,485 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-11 21:24:18,485 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=dcc7bf416a91a6a8f4c44c144f7973d5, UNASSIGN in 658 msec 2023-07-11 21:24:18,504 INFO [PEWorker-5] assignment.SplitTableRegionProcedure(694): pid=12 splitting 3 storefiles, region=dcc7bf416a91a6a8f4c44c144f7973d5, threads=3 2023-07-11 21:24:18,507 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/40ec94b253784fcf9e26f3c92c37d785 for region: dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:18,519 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4850d756443643b5950f106049c4b3f9 for region: dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:18,519 DEBUG [StoreFileSplitter-pool-2] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4d58d4ac63df46ce966ffddcc85ac5ac for region: dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:18,532 DEBUG [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/40ec94b253784fcf9e26f3c92c37d785, top=true 2023-07-11 21:24:18,534 DEBUG [StoreFileSplitter-pool-2] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4d58d4ac63df46ce966ffddcc85ac5ac, top=true 2023-07-11 21:24:18,588 INFO [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.splits/e9f7d63a9c90d49f5f03c967759a0923/info/TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-40ec94b253784fcf9e26f3c92c37d785 for child: e9f7d63a9c90d49f5f03c967759a0923, parent: dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:18,588 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/40ec94b253784fcf9e26f3c92c37d785 for region: dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:18,600 INFO [StoreFileSplitter-pool-2] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/.splits/e9f7d63a9c90d49f5f03c967759a0923/info/TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-4d58d4ac63df46ce966ffddcc85ac5ac for child: e9f7d63a9c90d49f5f03c967759a0923, parent: dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:18,600 DEBUG [StoreFileSplitter-pool-2] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4d58d4ac63df46ce966ffddcc85ac5ac for region: dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:18,623 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4850d756443643b5950f106049c4b3f9 for region: dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:24:18,623 DEBUG [PEWorker-5] assignment.SplitTableRegionProcedure(755): pid=12 split storefiles for region dcc7bf416a91a6a8f4c44c144f7973d5 Daughter A: 1 storefiles, Daughter B: 3 storefiles. 2023-07-11 21:24:18,671 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40/recovered.edits/123.seqid, newMaxSeqId=123, maxSeqId=-1 2023-07-11 21:24:18,674 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/recovered.edits/123.seqid, newMaxSeqId=123, maxSeqId=-1 2023-07-11 21:24:18,677 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689110658676"},{"qualifier":"splitA","vlen":70,"tag":[],"timestamp":"1689110658676"},{"qualifier":"splitB","vlen":70,"tag":[],"timestamp":"1689110658676"}]},"ts":"1689110658676"} 2023-07-11 21:24:18,677 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689110658676"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689110658676"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689110658676"}]},"ts":"1689110658676"} 2023-07-11 21:24:18,677 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689110658676"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689110658676"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689110658676"}]},"ts":"1689110658676"} 2023-07-11 21:24:18,814 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42399] regionserver.HRegion(9158): Flush requested on 1588230740 2023-07-11 21:24:18,814 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy(69): Since none of the CFs were above the size, flushing all. 2023-07-11 21:24:18,814 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=4.82 KB heapSize=8.36 KB 2023-07-11 21:24:18,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=fbfa6f3489084a38f3c6c6a7505bfc40, ASSIGN}, {pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e9f7d63a9c90d49f5f03c967759a0923, ASSIGN}] 2023-07-11 21:24:18,831 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e9f7d63a9c90d49f5f03c967759a0923, ASSIGN 2023-07-11 21:24:18,831 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=fbfa6f3489084a38f3c6c6a7505bfc40, ASSIGN 2023-07-11 21:24:18,832 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e9f7d63a9c90d49f5f03c967759a0923, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase5.apache.org,42399,1689110621305; forceNewPlan=false, retain=false 2023-07-11 21:24:18,833 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=fbfa6f3489084a38f3c6c6a7505bfc40, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase5.apache.org,42399,1689110621305; forceNewPlan=false, retain=false 2023-07-11 21:24:18,845 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.61 KB at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/.tmp/info/651c6b7c6e74496080180e3d9a3e8562 2023-07-11 21:24:18,870 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=216 B at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/.tmp/table/fb35cb8c4e5946339a1a83bc8b3f108e 2023-07-11 21:24:18,878 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/.tmp/info/651c6b7c6e74496080180e3d9a3e8562 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/info/651c6b7c6e74496080180e3d9a3e8562 2023-07-11 21:24:18,884 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/info/651c6b7c6e74496080180e3d9a3e8562, entries=29, sequenceid=17, filesize=8.6 K 2023-07-11 21:24:18,885 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/.tmp/table/fb35cb8c4e5946339a1a83bc8b3f108e as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/table/fb35cb8c4e5946339a1a83bc8b3f108e 2023-07-11 21:24:18,891 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/table/fb35cb8c4e5946339a1a83bc8b3f108e, entries=4, sequenceid=17, filesize=4.8 K 2023-07-11 21:24:18,892 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~4.82 KB/4934, heapSize ~8.08 KB/8272, currentSize=0 B/0 for 1588230740 in 78ms, sequenceid=17, compaction requested=false 2023-07-11 21:24:18,893 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-07-11 21:24:18,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e9f7d63a9c90d49f5f03c967759a0923, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:24:18,984 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=fbfa6f3489084a38f3c6c6a7505bfc40, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:24:18,984 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689110658984"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689110658984"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689110658984"}]},"ts":"1689110658984"} 2023-07-11 21:24:18,984 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689110658984"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689110658984"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689110658984"}]},"ts":"1689110658984"} 2023-07-11 21:24:18,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305}] 2023-07-11 21:24:18,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=15, state=RUNNABLE; OpenRegionProcedure fbfa6f3489084a38f3c6c6a7505bfc40, server=jenkins-hbase5.apache.org,42399,1689110621305}] 2023-07-11 21:24:19,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:24:19,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9f7d63a9c90d49f5f03c967759a0923, NAME => 'TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.', STARTKEY => 'row0064', ENDKEY => ''} 2023-07-11 21:24:19,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:19,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:24:19,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:19,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:19,144 INFO [StoreOpener-e9f7d63a9c90d49f5f03c967759a0923-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:19,145 DEBUG [StoreOpener-e9f7d63a9c90d49f5f03c967759a0923-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info 2023-07-11 21:24:19,145 DEBUG [StoreOpener-e9f7d63a9c90d49f5f03c967759a0923-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info 2023-07-11 21:24:19,146 INFO [StoreOpener-e9f7d63a9c90d49f5f03c967759a0923-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9f7d63a9c90d49f5f03c967759a0923 columnFamilyName info 2023-07-11 21:24:19,158 DEBUG [StoreOpener-e9f7d63a9c90d49f5f03c967759a0923-1] regionserver.HStore(539): loaded hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/4850d756443643b5950f106049c4b3f9.dcc7bf416a91a6a8f4c44c144f7973d5->hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4850d756443643b5950f106049c4b3f9-top 2023-07-11 21:24:19,164 DEBUG [StoreOpener-e9f7d63a9c90d49f5f03c967759a0923-1] regionserver.HStore(539): loaded hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-40ec94b253784fcf9e26f3c92c37d785 2023-07-11 21:24:19,168 DEBUG [StoreOpener-e9f7d63a9c90d49f5f03c967759a0923-1] regionserver.HStore(539): loaded hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-4d58d4ac63df46ce966ffddcc85ac5ac 2023-07-11 21:24:19,169 INFO [StoreOpener-e9f7d63a9c90d49f5f03c967759a0923-1] regionserver.HStore(310): Store=e9f7d63a9c90d49f5f03c967759a0923/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:24:19,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:19,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:19,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:19,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened e9f7d63a9c90d49f5f03c967759a0923; next sequenceid=124; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=706075, jitterRate=-0.10217978060245514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:24:19,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:24:19,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923., pid=17, masterSystemTime=1689110659139 2023-07-11 21:24:19,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:19,179 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 21:24:19,180 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:24:19,180 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1912): e9f7d63a9c90d49f5f03c967759a0923/info is initiating minor compaction (all files) 2023-07-11 21:24:19,180 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e9f7d63a9c90d49f5f03c967759a0923/info in TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:24:19,180 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/4850d756443643b5950f106049c4b3f9.dcc7bf416a91a6a8f4c44c144f7973d5->hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4850d756443643b5950f106049c4b3f9-top, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-40ec94b253784fcf9e26f3c92c37d785, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-4d58d4ac63df46ce966ffddcc85ac5ac] into tmpdir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp, totalSize=113.3 K 2023-07-11 21:24:19,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:24:19,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:24:19,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40. 2023-07-11 21:24:19,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fbfa6f3489084a38f3c6c6a7505bfc40, NAME => 'TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40.', STARTKEY => '', ENDKEY => 'row0064'} 2023-07-11 21:24:19,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling fbfa6f3489084a38f3c6c6a7505bfc40 2023-07-11 21:24:19,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:24:19,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for fbfa6f3489084a38f3c6c6a7505bfc40 2023-07-11 21:24:19,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for fbfa6f3489084a38f3c6c6a7505bfc40 2023-07-11 21:24:19,182 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e9f7d63a9c90d49f5f03c967759a0923, regionState=OPEN, openSeqNum=124, regionLocation=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:24:19,183 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689110659182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689110659182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689110659182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689110659182"}]},"ts":"1689110659182"} 2023-07-11 21:24:19,183 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 4850d756443643b5950f106049c4b3f9.dcc7bf416a91a6a8f4c44c144f7973d5, keycount=34, bloomtype=ROW, size=75.0 K, encoding=NONE, compression=NONE, seqNum=86, earliestPutTs=1689110633076 2023-07-11 21:24:19,184 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-40ec94b253784fcf9e26f3c92c37d785, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=110, earliestPutTs=1689110657271 2023-07-11 21:24:19,185 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-4d58d4ac63df46ce966ffddcc85ac5ac, keycount=6, bloomtype=ROW, size=10.9 K, encoding=NONE, compression=NONE, seqNum=120, earliestPutTs=1689110657301 2023-07-11 21:24:19,188 INFO [StoreOpener-fbfa6f3489084a38f3c6c6a7505bfc40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fbfa6f3489084a38f3c6c6a7505bfc40 2023-07-11 21:24:19,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-07-11 21:24:19,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 in 199 msec 2023-07-11 21:24:19,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e9f7d63a9c90d49f5f03c967759a0923, ASSIGN in 360 msec 2023-07-11 21:24:19,192 DEBUG [StoreOpener-fbfa6f3489084a38f3c6c6a7505bfc40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40/info 2023-07-11 21:24:19,192 DEBUG [StoreOpener-fbfa6f3489084a38f3c6c6a7505bfc40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40/info 2023-07-11 21:24:19,192 INFO [StoreOpener-fbfa6f3489084a38f3c6c6a7505bfc40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbfa6f3489084a38f3c6c6a7505bfc40 columnFamilyName info 2023-07-11 21:24:19,204 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] throttle.PressureAwareThroughputController(145): e9f7d63a9c90d49f5f03c967759a0923#info#compaction#26 average throughput is 16.54 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 21:24:19,239 DEBUG [StoreOpener-fbfa6f3489084a38f3c6c6a7505bfc40-1] regionserver.HStore(539): loaded hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40/info/4850d756443643b5950f106049c4b3f9.dcc7bf416a91a6a8f4c44c144f7973d5->hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4850d756443643b5950f106049c4b3f9-bottom 2023-07-11 21:24:19,262 INFO [StoreOpener-fbfa6f3489084a38f3c6c6a7505bfc40-1] regionserver.HStore(310): Store=fbfa6f3489084a38f3c6c6a7505bfc40/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:24:19,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40 2023-07-11 21:24:19,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40 2023-07-11 21:24:19,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for fbfa6f3489084a38f3c6c6a7505bfc40 2023-07-11 21:24:19,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened fbfa6f3489084a38f3c6c6a7505bfc40; next sequenceid=124; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=783474, jitterRate=-0.0037620961666107178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:24:19,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for fbfa6f3489084a38f3c6c6a7505bfc40: 2023-07-11 21:24:19,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40., pid=18, masterSystemTime=1689110659139 2023-07-11 21:24:19,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:19,290 DEBUG [RS:0;jenkins-hbase5:42399-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 21:24:19,291 INFO [RS:0;jenkins-hbase5:42399-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40. 2023-07-11 21:24:19,291 DEBUG [RS:0;jenkins-hbase5:42399-longCompactions-0] regionserver.HStore(1912): fbfa6f3489084a38f3c6c6a7505bfc40/info is initiating minor compaction (all files) 2023-07-11 21:24:19,291 INFO [RS:0;jenkins-hbase5:42399-longCompactions-0] regionserver.HRegion(2259): Starting compaction of fbfa6f3489084a38f3c6c6a7505bfc40/info in TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40. 2023-07-11 21:24:19,291 INFO [RS:0;jenkins-hbase5:42399-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40/info/4850d756443643b5950f106049c4b3f9.dcc7bf416a91a6a8f4c44c144f7973d5->hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4850d756443643b5950f106049c4b3f9-bottom] into tmpdir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40/.tmp, totalSize=75.0 K 2023-07-11 21:24:19,292 DEBUG [RS:0;jenkins-hbase5:42399-longCompactions-0] compactions.Compactor(207): Compacting 4850d756443643b5950f106049c4b3f9.dcc7bf416a91a6a8f4c44c144f7973d5, keycount=34, bloomtype=ROW, size=75.0 K, encoding=NONE, compression=NONE, seqNum=85, earliestPutTs=1689110633076 2023-07-11 21:24:19,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40. 2023-07-11 21:24:19,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40. 2023-07-11 21:24:19,296 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=fbfa6f3489084a38f3c6c6a7505bfc40, regionState=OPEN, openSeqNum=124, regionLocation=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:24:19,296 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689110659295"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689110659295"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689110659295"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689110659295"}]},"ts":"1689110659295"} 2023-07-11 21:24:19,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=15 2023-07-11 21:24:19,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=15, state=SUCCESS; OpenRegionProcedure fbfa6f3489084a38f3c6c6a7505bfc40, server=jenkins-hbase5.apache.org,42399,1689110621305 in 311 msec 2023-07-11 21:24:19,304 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=12 2023-07-11 21:24:19,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=fbfa6f3489084a38f3c6c6a7505bfc40, ASSIGN in 472 msec 2023-07-11 21:24:19,307 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=dcc7bf416a91a6a8f4c44c144f7973d5, daughterA=fbfa6f3489084a38f3c6c6a7505bfc40, daughterB=e9f7d63a9c90d49f5f03c967759a0923 in 1.5010 sec 2023-07-11 21:24:19,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Mutate size: 1.1 K connection: 172.31.10.131:40308 deadline: 1689110669319, exception=org.apache.hadoop.hbase.NotServingRegionException: TestLogRolling-testLogRolling,,1689110623061.dcc7bf416a91a6a8f4c44c144f7973d5. is not online on jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:24:19,322 INFO [RS:0;jenkins-hbase5:42399-longCompactions-0] throttle.PressureAwareThroughputController(145): fbfa6f3489084a38f3c6c6a7505bfc40#info#compaction#27 average throughput is 21.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 21:24:19,407 DEBUG [RS:0;jenkins-hbase5:42399-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40/.tmp/info/61a6a9f4eb234e0686bd8cc73e18b5fc as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40/info/61a6a9f4eb234e0686bd8cc73e18b5fc 2023-07-11 21:24:19,425 INFO [RS:0;jenkins-hbase5:42399-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in fbfa6f3489084a38f3c6c6a7505bfc40/info of fbfa6f3489084a38f3c6c6a7505bfc40 into 61a6a9f4eb234e0686bd8cc73e18b5fc(size=69.7 K), total size for store is 69.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 21:24:19,425 DEBUG [RS:0;jenkins-hbase5:42399-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for fbfa6f3489084a38f3c6c6a7505bfc40: 2023-07-11 21:24:19,425 INFO [RS:0;jenkins-hbase5:42399-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40., storeName=fbfa6f3489084a38f3c6c6a7505bfc40/info, priority=15, startTime=1689110659288; duration=0sec 2023-07-11 21:24:19,425 DEBUG [RS:0;jenkins-hbase5:42399-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:19,688 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/62cc089f481b48eb92180a3b706a7b47 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/62cc089f481b48eb92180a3b706a7b47 2023-07-11 21:24:19,695 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e9f7d63a9c90d49f5f03c967759a0923/info of e9f7d63a9c90d49f5f03c967759a0923 into 62cc089f481b48eb92180a3b706a7b47(size=39.0 K), total size for store is 39.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 21:24:19,695 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:24:19,695 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923., storeName=e9f7d63a9c90d49f5f03c967759a0923/info, priority=13, startTime=1689110659178; duration=0sec 2023-07-11 21:24:19,695 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:24,028 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-11 21:24:29,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:29,389 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e9f7d63a9c90d49f5f03c967759a0923 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-11 21:24:29,422 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:24:29,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.10.131:40308 deadline: 1689110679421, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:24:29,461 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=135 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/596ddf4229ca4ccf83450f7b362b19d7 2023-07-11 21:24:29,469 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/596ddf4229ca4ccf83450f7b362b19d7 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/596ddf4229ca4ccf83450f7b362b19d7 2023-07-11 21:24:29,476 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/596ddf4229ca4ccf83450f7b362b19d7, entries=8, sequenceid=135, filesize=13.0 K 2023-07-11 21:24:29,478 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for e9f7d63a9c90d49f5f03c967759a0923 in 89ms, sequenceid=135, compaction requested=false 2023-07-11 21:24:29,478 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:24:39,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:39,513 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e9f7d63a9c90d49f5f03c967759a0923 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-11 21:24:39,531 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/37d111b04b8b4f01a89d1b2a8fffb13f 2023-07-11 21:24:39,537 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/37d111b04b8b4f01a89d1b2a8fffb13f as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/37d111b04b8b4f01a89d1b2a8fffb13f 2023-07-11 21:24:39,544 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/37d111b04b8b4f01a89d1b2a8fffb13f, entries=22, sequenceid=160, filesize=27.4 K 2023-07-11 21:24:39,545 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for e9f7d63a9c90d49f5f03c967759a0923 in 32ms, sequenceid=160, compaction requested=true 2023-07-11 21:24:39,545 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:24:39,545 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:39,545 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 21:24:39,547 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 81224 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 21:24:39,547 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1912): e9f7d63a9c90d49f5f03c967759a0923/info is initiating minor compaction (all files) 2023-07-11 21:24:39,547 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e9f7d63a9c90d49f5f03c967759a0923/info in TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:24:39,547 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/62cc089f481b48eb92180a3b706a7b47, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/596ddf4229ca4ccf83450f7b362b19d7, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/37d111b04b8b4f01a89d1b2a8fffb13f] into tmpdir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp, totalSize=79.3 K 2023-07-11 21:24:39,547 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 62cc089f481b48eb92180a3b706a7b47, keycount=33, bloomtype=ROW, size=39.0 K, encoding=NONE, compression=NONE, seqNum=120, earliestPutTs=1689110655264 2023-07-11 21:24:39,548 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 596ddf4229ca4ccf83450f7b362b19d7, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=135, earliestPutTs=1689110669378 2023-07-11 21:24:39,548 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 37d111b04b8b4f01a89d1b2a8fffb13f, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=160, earliestPutTs=1689110669390 2023-07-11 21:24:39,561 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] throttle.PressureAwareThroughputController(145): e9f7d63a9c90d49f5f03c967759a0923#info#compaction#30 average throughput is 31.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 21:24:39,594 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/eb1aa671864540d3864c8bd0db6ec834 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/eb1aa671864540d3864c8bd0db6ec834 2023-07-11 21:24:39,602 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e9f7d63a9c90d49f5f03c967759a0923/info of e9f7d63a9c90d49f5f03c967759a0923 into eb1aa671864540d3864c8bd0db6ec834(size=70.0 K), total size for store is 70.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 21:24:39,602 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:24:39,602 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923., storeName=e9f7d63a9c90d49f5f03c967759a0923/info, priority=13, startTime=1689110679545; duration=0sec 2023-07-11 21:24:39,602 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:41,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:41,530 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e9f7d63a9c90d49f5f03c967759a0923 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-11 21:24:41,573 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:24:41,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] ipc.CallRunner(144): callId: 174 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.10.131:40308 deadline: 1689110691572, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:24:41,603 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=172 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/0c9ea4047110484f9dec77f4a4d03e58 2023-07-11 21:24:41,613 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/0c9ea4047110484f9dec77f4a4d03e58 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/0c9ea4047110484f9dec77f4a4d03e58 2023-07-11 21:24:41,626 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/0c9ea4047110484f9dec77f4a4d03e58, entries=8, sequenceid=172, filesize=13.0 K 2023-07-11 21:24:41,628 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for e9f7d63a9c90d49f5f03c967759a0923 in 98ms, sequenceid=172, compaction requested=false 2023-07-11 21:24:41,628 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:24:51,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:51,645 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e9f7d63a9c90d49f5f03c967759a0923 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-11 21:24:51,659 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=197 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/de0b5c99831d46e7beac802b0ba07aa5 2023-07-11 21:24:51,664 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/de0b5c99831d46e7beac802b0ba07aa5 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/de0b5c99831d46e7beac802b0ba07aa5 2023-07-11 21:24:51,670 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/de0b5c99831d46e7beac802b0ba07aa5, entries=22, sequenceid=197, filesize=27.4 K 2023-07-11 21:24:51,670 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=4.11 KB/4204 for e9f7d63a9c90d49f5f03c967759a0923 in 25ms, sequenceid=197, compaction requested=true 2023-07-11 21:24:51,671 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:24:51,671 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:51,671 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 21:24:51,672 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 112988 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 21:24:51,672 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1912): e9f7d63a9c90d49f5f03c967759a0923/info is initiating minor compaction (all files) 2023-07-11 21:24:51,672 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e9f7d63a9c90d49f5f03c967759a0923/info in TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:24:51,672 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/eb1aa671864540d3864c8bd0db6ec834, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/0c9ea4047110484f9dec77f4a4d03e58, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/de0b5c99831d46e7beac802b0ba07aa5] into tmpdir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp, totalSize=110.3 K 2023-07-11 21:24:51,673 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting eb1aa671864540d3864c8bd0db6ec834, keycount=63, bloomtype=ROW, size=70.0 K, encoding=NONE, compression=NONE, seqNum=160, earliestPutTs=1689110655264 2023-07-11 21:24:51,673 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 0c9ea4047110484f9dec77f4a4d03e58, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=172, earliestPutTs=1689110679514 2023-07-11 21:24:51,674 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting de0b5c99831d46e7beac802b0ba07aa5, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=197, earliestPutTs=1689110681531 2023-07-11 21:24:51,688 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] throttle.PressureAwareThroughputController(145): e9f7d63a9c90d49f5f03c967759a0923#info#compaction#33 average throughput is 31.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 21:24:51,715 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/9c699202744848e0b548c57946d460be as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/9c699202744848e0b548c57946d460be 2023-07-11 21:24:51,729 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e9f7d63a9c90d49f5f03c967759a0923/info of e9f7d63a9c90d49f5f03c967759a0923 into 9c699202744848e0b548c57946d460be(size=101.0 K), total size for store is 101.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 21:24:51,729 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:24:51,729 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923., storeName=e9f7d63a9c90d49f5f03c967759a0923/info, priority=13, startTime=1689110691671; duration=0sec 2023-07-11 21:24:51,729 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:24:53,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:24:53,657 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e9f7d63a9c90d49f5f03c967759a0923 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-11 21:24:53,672 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=209 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/bce4da2c385346f8b19f6584f8efdd94 2023-07-11 21:24:53,680 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/bce4da2c385346f8b19f6584f8efdd94 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/bce4da2c385346f8b19f6584f8efdd94 2023-07-11 21:24:53,687 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/bce4da2c385346f8b19f6584f8efdd94, entries=8, sequenceid=209, filesize=13.0 K 2023-07-11 21:24:53,687 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:24:53,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.10.131:40308 deadline: 1689110703687, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:24:53,688 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for e9f7d63a9c90d49f5f03c967759a0923 in 31ms, sequenceid=209, compaction requested=false 2023-07-11 21:24:53,688 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:25:03,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:25:03,740 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e9f7d63a9c90d49f5f03c967759a0923 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-11 21:25:03,755 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=234 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/36f8a3d636fc4076adba569ef0440315 2023-07-11 21:25:03,761 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/36f8a3d636fc4076adba569ef0440315 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/36f8a3d636fc4076adba569ef0440315 2023-07-11 21:25:03,767 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/36f8a3d636fc4076adba569ef0440315, entries=22, sequenceid=234, filesize=27.4 K 2023-07-11 21:25:03,768 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=6.16 KB/6306 for e9f7d63a9c90d49f5f03c967759a0923 in 28ms, sequenceid=234, compaction requested=true 2023-07-11 21:25:03,768 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:25:03,768 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:25:03,768 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 21:25:03,769 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 144753 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 21:25:03,769 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1912): e9f7d63a9c90d49f5f03c967759a0923/info is initiating minor compaction (all files) 2023-07-11 21:25:03,770 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e9f7d63a9c90d49f5f03c967759a0923/info in TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:25:03,770 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/9c699202744848e0b548c57946d460be, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/bce4da2c385346f8b19f6584f8efdd94, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/36f8a3d636fc4076adba569ef0440315] into tmpdir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp, totalSize=141.4 K 2023-07-11 21:25:03,770 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 9c699202744848e0b548c57946d460be, keycount=93, bloomtype=ROW, size=101.0 K, encoding=NONE, compression=NONE, seqNum=197, earliestPutTs=1689110655264 2023-07-11 21:25:03,770 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting bce4da2c385346f8b19f6584f8efdd94, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=209, earliestPutTs=1689110691646 2023-07-11 21:25:03,771 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 36f8a3d636fc4076adba569ef0440315, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=234, earliestPutTs=1689110693658 2023-07-11 21:25:03,784 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] throttle.PressureAwareThroughputController(145): e9f7d63a9c90d49f5f03c967759a0923#info#compaction#36 average throughput is 41.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 21:25:04,209 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/d3bb818f46fc462baa772b0444065276 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/d3bb818f46fc462baa772b0444065276 2023-07-11 21:25:04,216 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e9f7d63a9c90d49f5f03c967759a0923/info of e9f7d63a9c90d49f5f03c967759a0923 into d3bb818f46fc462baa772b0444065276(size=132.1 K), total size for store is 132.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 21:25:04,216 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:25:04,216 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923., storeName=e9f7d63a9c90d49f5f03c967759a0923/info, priority=13, startTime=1689110703768; duration=0sec 2023-07-11 21:25:04,216 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:25:05,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:25:05,758 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e9f7d63a9c90d49f5f03c967759a0923 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-11 21:25:05,786 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=246 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/f26744d379ab4d18a8e08c1789c18944 2023-07-11 21:25:05,793 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/f26744d379ab4d18a8e08c1789c18944 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/f26744d379ab4d18a8e08c1789c18944 2023-07-11 21:25:05,793 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:25:05,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] ipc.CallRunner(144): callId: 238 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.10.131:40308 deadline: 1689110715793, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:25:05,799 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/f26744d379ab4d18a8e08c1789c18944, entries=8, sequenceid=246, filesize=13.0 K 2023-07-11 21:25:05,800 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for e9f7d63a9c90d49f5f03c967759a0923 in 42ms, sequenceid=246, compaction requested=false 2023-07-11 21:25:05,800 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:25:15,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:25:15,805 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e9f7d63a9c90d49f5f03c967759a0923 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-11 21:25:15,827 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:25:15,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] ipc.CallRunner(144): callId: 248 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.10.131:40308 deadline: 1689110725826, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:25:15,924 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=271 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/c0a195505182467eb57cc2d06a647203 2023-07-11 21:25:15,953 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/c0a195505182467eb57cc2d06a647203 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/c0a195505182467eb57cc2d06a647203 2023-07-11 21:25:15,973 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/c0a195505182467eb57cc2d06a647203, entries=22, sequenceid=271, filesize=27.4 K 2023-07-11 21:25:15,974 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=7.18 KB/7357 for e9f7d63a9c90d49f5f03c967759a0923 in 169ms, sequenceid=271, compaction requested=true 2023-07-11 21:25:15,974 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:25:15,975 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:25:15,975 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 21:25:15,977 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 176595 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 21:25:15,977 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1912): e9f7d63a9c90d49f5f03c967759a0923/info is initiating minor compaction (all files) 2023-07-11 21:25:15,977 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e9f7d63a9c90d49f5f03c967759a0923/info in TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:25:15,977 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/d3bb818f46fc462baa772b0444065276, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/f26744d379ab4d18a8e08c1789c18944, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/c0a195505182467eb57cc2d06a647203] into tmpdir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp, totalSize=172.5 K 2023-07-11 21:25:15,978 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting d3bb818f46fc462baa772b0444065276, keycount=123, bloomtype=ROW, size=132.1 K, encoding=NONE, compression=NONE, seqNum=234, earliestPutTs=1689110655264 2023-07-11 21:25:15,978 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting f26744d379ab4d18a8e08c1789c18944, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=246, earliestPutTs=1689110703741 2023-07-11 21:25:15,979 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting c0a195505182467eb57cc2d06a647203, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=271, earliestPutTs=1689110705759 2023-07-11 21:25:16,040 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] throttle.PressureAwareThroughputController(145): e9f7d63a9c90d49f5f03c967759a0923#info#compaction#39 average throughput is 51.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 21:25:16,138 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/0f0243eabba145299c9f47a75147f2f8 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/0f0243eabba145299c9f47a75147f2f8 2023-07-11 21:25:16,149 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e9f7d63a9c90d49f5f03c967759a0923/info of e9f7d63a9c90d49f5f03c967759a0923 into 0f0243eabba145299c9f47a75147f2f8(size=163.1 K), total size for store is 163.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 21:25:16,149 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:25:16,149 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923., storeName=e9f7d63a9c90d49f5f03c967759a0923/info, priority=13, startTime=1689110715974; duration=0sec 2023-07-11 21:25:16,149 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:25:25,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:25:25,926 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e9f7d63a9c90d49f5f03c967759a0923 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-11 21:25:25,944 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=283 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/a706222b2b9d48c5a4c354be28b8ed9f 2023-07-11 21:25:25,957 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/a706222b2b9d48c5a4c354be28b8ed9f as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/a706222b2b9d48c5a4c354be28b8ed9f 2023-07-11 21:25:25,964 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/a706222b2b9d48c5a4c354be28b8ed9f, entries=8, sequenceid=283, filesize=13.0 K 2023-07-11 21:25:25,965 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=0 B/0 for e9f7d63a9c90d49f5f03c967759a0923 in 39ms, sequenceid=283, compaction requested=false 2023-07-11 21:25:25,965 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:25:27,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:25:27,935 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e9f7d63a9c90d49f5f03c967759a0923 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-11 21:25:27,961 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=294 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/29b3be0b8a2f4eebaec0a3b59198683d 2023-07-11 21:25:27,967 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/29b3be0b8a2f4eebaec0a3b59198683d as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/29b3be0b8a2f4eebaec0a3b59198683d 2023-07-11 21:25:27,969 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 21:25:27,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] ipc.CallRunner(144): callId: 280 service: ClientService methodName: Mutate size: 1.2 K connection: 172.31.10.131:40308 deadline: 1689110737969, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=e9f7d63a9c90d49f5f03c967759a0923, server=jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:25:27,974 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/29b3be0b8a2f4eebaec0a3b59198683d, entries=8, sequenceid=294, filesize=13.0 K 2023-07-11 21:25:27,975 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for e9f7d63a9c90d49f5f03c967759a0923 in 40ms, sequenceid=294, compaction requested=true 2023-07-11 21:25:27,975 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:25:27,975 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:25:27,975 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 21:25:27,976 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 193617 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 21:25:27,976 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1912): e9f7d63a9c90d49f5f03c967759a0923/info is initiating minor compaction (all files) 2023-07-11 21:25:27,977 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e9f7d63a9c90d49f5f03c967759a0923/info in TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:25:27,977 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/0f0243eabba145299c9f47a75147f2f8, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/a706222b2b9d48c5a4c354be28b8ed9f, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/29b3be0b8a2f4eebaec0a3b59198683d] into tmpdir=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp, totalSize=189.1 K 2023-07-11 21:25:27,977 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 0f0243eabba145299c9f47a75147f2f8, keycount=153, bloomtype=ROW, size=163.1 K, encoding=NONE, compression=NONE, seqNum=271, earliestPutTs=1689110655264 2023-07-11 21:25:27,978 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting a706222b2b9d48c5a4c354be28b8ed9f, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=283, earliestPutTs=1689110715806 2023-07-11 21:25:27,978 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] compactions.Compactor(207): Compacting 29b3be0b8a2f4eebaec0a3b59198683d, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=294, earliestPutTs=1689110727927 2023-07-11 21:25:27,994 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] throttle.PressureAwareThroughputController(145): e9f7d63a9c90d49f5f03c967759a0923#info#compaction#42 average throughput is 33.88 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 21:25:28,013 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/f47fe97caa0d4258928f4815092199fd as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/f47fe97caa0d4258928f4815092199fd 2023-07-11 21:25:28,019 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e9f7d63a9c90d49f5f03c967759a0923/info of e9f7d63a9c90d49f5f03c967759a0923 into f47fe97caa0d4258928f4815092199fd(size=179.7 K), total size for store is 179.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 21:25:28,019 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:25:28,019 INFO [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923., storeName=e9f7d63a9c90d49f5f03c967759a0923/info, priority=13, startTime=1689110727975; duration=0sec 2023-07-11 21:25:28,020 DEBUG [RS:0;jenkins-hbase5:42399-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 21:25:37,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42399] regionserver.HRegion(9158): Flush requested on e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:25:37,980 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e9f7d63a9c90d49f5f03c967759a0923 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-11 21:25:37,999 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=320 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/78429761d91c40d59f7f0f8e3ed576c9 2023-07-11 21:25:38,013 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/78429761d91c40d59f7f0f8e3ed576c9 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/78429761d91c40d59f7f0f8e3ed576c9 2023-07-11 21:25:38,019 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/78429761d91c40d59f7f0f8e3ed576c9, entries=22, sequenceid=320, filesize=27.4 K 2023-07-11 21:25:38,020 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for e9f7d63a9c90d49f5f03c967759a0923 in 40ms, sequenceid=320, compaction requested=false 2023-07-11 21:25:38,020 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:25:39,985 INFO [Listener at localhost/39973] wal.AbstractTestLogRolling(188): after writing there are 0 log files 2023-07-11 21:25:40,003 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41555,DS-1a8a0f83-c436-4bf7-9869-fd25221d04ee,DISK] 2023-07-11 21:25:40,004 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42995,DS-fa6e1d3c-2d8e-4585-90e0-ee90690b3286,DISK] 2023-07-11 21:25:40,009 INFO [Listener at localhost/39973] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305/jenkins-hbase5.apache.org%2C42399%2C1689110621305.1689110622110 with entries=308, filesize=300.35 KB; new WAL /user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305/jenkins-hbase5.apache.org%2C42399%2C1689110621305.1689110739985 2023-07-11 21:25:40,009 DEBUG [Listener at localhost/39973] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41555,DS-1a8a0f83-c436-4bf7-9869-fd25221d04ee,DISK], DatanodeInfoWithStorage[127.0.0.1:42995,DS-fa6e1d3c-2d8e-4585-90e0-ee90690b3286,DISK]] 2023-07-11 21:25:40,010 DEBUG [Listener at localhost/39973] wal.AbstractFSWAL(716): hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305/jenkins-hbase5.apache.org%2C42399%2C1689110621305.1689110622110 is not closed yet, will try archiving it next time 2023-07-11 21:25:40,015 DEBUG [Listener at localhost/39973] regionserver.HRegion(2446): Flush status journal for fbfa6f3489084a38f3c6c6a7505bfc40: 2023-07-11 21:25:40,016 INFO [Listener at localhost/39973] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.26 KB heapSize=4.19 KB 2023-07-11 21:25:40,027 INFO [Listener at localhost/39973] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.26 KB at sequenceid=24 (bloomFilter=false), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/.tmp/info/0a171bd80a0f4f2db024607c9f4bd46a 2023-07-11 21:25:40,033 DEBUG [Listener at localhost/39973] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/.tmp/info/0a171bd80a0f4f2db024607c9f4bd46a as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/info/0a171bd80a0f4f2db024607c9f4bd46a 2023-07-11 21:25:40,039 INFO [Listener at localhost/39973] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/info/0a171bd80a0f4f2db024607c9f4bd46a, entries=16, sequenceid=24, filesize=7.0 K 2023-07-11 21:25:40,040 INFO [Listener at localhost/39973] regionserver.HRegion(2948): Finished flush of dataSize ~2.26 KB/2312, heapSize ~3.67 KB/3760, currentSize=0 B/0 for 1588230740 in 24ms, sequenceid=24, compaction requested=false 2023-07-11 21:25:40,040 DEBUG [Listener at localhost/39973] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-07-11 21:25:40,040 INFO [Listener at localhost/39973] regionserver.HRegion(2745): Flushing e9f7d63a9c90d49f5f03c967759a0923 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-07-11 21:25:40,057 INFO [Listener at localhost/39973] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=325 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/f7fa52012d99476f83ee7f6fa804aa76 2023-07-11 21:25:40,063 DEBUG [Listener at localhost/39973] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/.tmp/info/f7fa52012d99476f83ee7f6fa804aa76 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/f7fa52012d99476f83ee7f6fa804aa76 2023-07-11 21:25:40,069 INFO [Listener at localhost/39973] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/f7fa52012d99476f83ee7f6fa804aa76, entries=2, sequenceid=325, filesize=6.8 K 2023-07-11 21:25:40,070 INFO [Listener at localhost/39973] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for e9f7d63a9c90d49f5f03c967759a0923 in 30ms, sequenceid=325, compaction requested=true 2023-07-11 21:25:40,070 DEBUG [Listener at localhost/39973] regionserver.HRegion(2446): Flush status journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:25:40,070 INFO [Listener at localhost/39973] regionserver.HRegion(2745): Flushing 1242f002de3271c68d62a7e848a42bfa 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 21:25:40,091 INFO [Listener at localhost/39973] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa/.tmp/info/825c449875b74189958c9500caf1c927 2023-07-11 21:25:40,097 DEBUG [Listener at localhost/39973] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa/.tmp/info/825c449875b74189958c9500caf1c927 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa/info/825c449875b74189958c9500caf1c927 2023-07-11 21:25:40,102 INFO [Listener at localhost/39973] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa/info/825c449875b74189958c9500caf1c927, entries=2, sequenceid=6, filesize=4.8 K 2023-07-11 21:25:40,103 INFO [Listener at localhost/39973] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1242f002de3271c68d62a7e848a42bfa in 33ms, sequenceid=6, compaction requested=false 2023-07-11 21:25:40,104 DEBUG [Listener at localhost/39973] regionserver.HRegion(2446): Flush status journal for 1242f002de3271c68d62a7e848a42bfa: 2023-07-11 21:25:40,118 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41555,DS-1a8a0f83-c436-4bf7-9869-fd25221d04ee,DISK] 2023-07-11 21:25:40,119 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42995,DS-fa6e1d3c-2d8e-4585-90e0-ee90690b3286,DISK] 2023-07-11 21:25:40,121 INFO [Listener at localhost/39973] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305/jenkins-hbase5.apache.org%2C42399%2C1689110621305.1689110739985 with entries=4, filesize=1.22 KB; new WAL /user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305/jenkins-hbase5.apache.org%2C42399%2C1689110621305.1689110740104 2023-07-11 21:25:40,121 DEBUG [Listener at localhost/39973] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41555,DS-1a8a0f83-c436-4bf7-9869-fd25221d04ee,DISK], DatanodeInfoWithStorage[127.0.0.1:42995,DS-fa6e1d3c-2d8e-4585-90e0-ee90690b3286,DISK]] 2023-07-11 21:25:40,121 DEBUG [Listener at localhost/39973] wal.AbstractFSWAL(716): hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305/jenkins-hbase5.apache.org%2C42399%2C1689110621305.1689110739985 is not closed yet, will try archiving it next time 2023-07-11 21:25:40,121 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305/jenkins-hbase5.apache.org%2C42399%2C1689110621305.1689110622110 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/oldWALs/jenkins-hbase5.apache.org%2C42399%2C1689110621305.1689110622110 2023-07-11 21:25:40,122 INFO [Listener at localhost/39973] hbase.Waiter(180): Waiting up to [5,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 21:25:40,123 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305/jenkins-hbase5.apache.org%2C42399%2C1689110621305.1689110739985 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/oldWALs/jenkins-hbase5.apache.org%2C42399%2C1689110621305.1689110739985 2023-07-11 21:25:40,222 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 21:25:40,222 INFO [Listener at localhost/39973] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 21:25:40,222 DEBUG [Listener at localhost/39973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77cf6fa7 to 127.0.0.1:62565 2023-07-11 21:25:40,222 DEBUG [Listener at localhost/39973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:25:40,222 DEBUG [Listener at localhost/39973] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 21:25:40,223 DEBUG [Listener at localhost/39973] util.JVMClusterUtil(257): Found active master hash=1852509779, stopped=false 2023-07-11 21:25:40,223 INFO [Listener at localhost/39973] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,45467,1689110621237 2023-07-11 21:25:40,224 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 21:25:40,224 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 21:25:40,224 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:40,224 INFO [Listener at localhost/39973] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 21:25:40,224 DEBUG [Listener at localhost/39973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x481ebb20 to 127.0.0.1:62565 2023-07-11 21:25:40,224 DEBUG [Listener at localhost/39973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:25:40,225 INFO [Listener at localhost/39973] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,42399,1689110621305' ***** 2023-07-11 21:25:40,225 INFO [Listener at localhost/39973] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 21:25:40,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:25:40,226 INFO [RS:0;jenkins-hbase5:42399] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 21:25:40,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:25:40,226 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 21:25:40,226 INFO [RS:0;jenkins-hbase5:42399] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 21:25:40,226 INFO [RS:0;jenkins-hbase5:42399] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 21:25:40,226 INFO [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(3305): Received CLOSE for fbfa6f3489084a38f3c6c6a7505bfc40 2023-07-11 21:25:40,226 INFO [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(3305): Received CLOSE for e9f7d63a9c90d49f5f03c967759a0923 2023-07-11 21:25:40,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing fbfa6f3489084a38f3c6c6a7505bfc40, disabling compactions & flushes 2023-07-11 21:25:40,226 INFO [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(3305): Received CLOSE for 1242f002de3271c68d62a7e848a42bfa 2023-07-11 21:25:40,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40. 2023-07-11 21:25:40,227 INFO [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:25:40,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40. 2023-07-11 21:25:40,227 DEBUG [RS:0;jenkins-hbase5:42399] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f13f6fb to 127.0.0.1:62565 2023-07-11 21:25:40,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40. after waiting 0 ms 2023-07-11 21:25:40,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40. 2023-07-11 21:25:40,227 DEBUG [RS:0;jenkins-hbase5:42399] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:25:40,227 INFO [RS:0;jenkins-hbase5:42399] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 21:25:40,227 INFO [RS:0;jenkins-hbase5:42399] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 21:25:40,227 INFO [RS:0;jenkins-hbase5:42399] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 21:25:40,227 INFO [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 21:25:40,229 INFO [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-07-11 21:25:40,230 DEBUG [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(1478): Online Regions={fbfa6f3489084a38f3c6c6a7505bfc40=TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40., 1588230740=hbase:meta,,1.1588230740, e9f7d63a9c90d49f5f03c967759a0923=TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923., 1242f002de3271c68d62a7e848a42bfa=hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa.} 2023-07-11 21:25:40,230 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 21:25:40,230 DEBUG [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(1504): Waiting on 1242f002de3271c68d62a7e848a42bfa, 1588230740, e9f7d63a9c90d49f5f03c967759a0923, fbfa6f3489084a38f3c6c6a7505bfc40 2023-07-11 21:25:40,230 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40/info/4850d756443643b5950f106049c4b3f9.dcc7bf416a91a6a8f4c44c144f7973d5->hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4850d756443643b5950f106049c4b3f9-bottom] to archive 2023-07-11 21:25:40,230 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 21:25:40,230 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 21:25:40,230 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 21:25:40,230 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 21:25:40,232 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 21:25:40,238 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40/info/4850d756443643b5950f106049c4b3f9.dcc7bf416a91a6a8f4c44c144f7973d5 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40/info/4850d756443643b5950f106049c4b3f9.dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:25:40,242 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/meta/1588230740/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-07-11 21:25:40,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:25:40,243 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 21:25:40,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 21:25:40,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 21:25:40,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/fbfa6f3489084a38f3c6c6a7505bfc40/recovered.edits/128.seqid, newMaxSeqId=128, maxSeqId=123 2023-07-11 21:25:40,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40. 2023-07-11 21:25:40,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for fbfa6f3489084a38f3c6c6a7505bfc40: 2023-07-11 21:25:40,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,,1689110657803.fbfa6f3489084a38f3c6c6a7505bfc40. 2023-07-11 21:25:40,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing e9f7d63a9c90d49f5f03c967759a0923, disabling compactions & flushes 2023-07-11 21:25:40,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:25:40,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:25:40,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. after waiting 0 ms 2023-07-11 21:25:40,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:25:40,273 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/4850d756443643b5950f106049c4b3f9.dcc7bf416a91a6a8f4c44c144f7973d5->hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/dcc7bf416a91a6a8f4c44c144f7973d5/info/4850d756443643b5950f106049c4b3f9-top, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-40ec94b253784fcf9e26f3c92c37d785, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/62cc089f481b48eb92180a3b706a7b47, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-4d58d4ac63df46ce966ffddcc85ac5ac, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/596ddf4229ca4ccf83450f7b362b19d7, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/eb1aa671864540d3864c8bd0db6ec834, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/37d111b04b8b4f01a89d1b2a8fffb13f, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/0c9ea4047110484f9dec77f4a4d03e58, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/9c699202744848e0b548c57946d460be, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/de0b5c99831d46e7beac802b0ba07aa5, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/bce4da2c385346f8b19f6584f8efdd94, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/d3bb818f46fc462baa772b0444065276, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/36f8a3d636fc4076adba569ef0440315, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/f26744d379ab4d18a8e08c1789c18944, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/0f0243eabba145299c9f47a75147f2f8, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/c0a195505182467eb57cc2d06a647203, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/a706222b2b9d48c5a4c354be28b8ed9f, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/29b3be0b8a2f4eebaec0a3b59198683d] to archive 2023-07-11 21:25:40,274 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 21:25:40,281 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/4850d756443643b5950f106049c4b3f9.dcc7bf416a91a6a8f4c44c144f7973d5 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/4850d756443643b5950f106049c4b3f9.dcc7bf416a91a6a8f4c44c144f7973d5 2023-07-11 21:25:40,282 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-40ec94b253784fcf9e26f3c92c37d785 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-40ec94b253784fcf9e26f3c92c37d785 2023-07-11 21:25:40,284 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/62cc089f481b48eb92180a3b706a7b47 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/62cc089f481b48eb92180a3b706a7b47 2023-07-11 21:25:40,287 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-4d58d4ac63df46ce966ffddcc85ac5ac to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/TestLogRolling-testLogRolling=dcc7bf416a91a6a8f4c44c144f7973d5-4d58d4ac63df46ce966ffddcc85ac5ac 2023-07-11 21:25:40,289 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/596ddf4229ca4ccf83450f7b362b19d7 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/596ddf4229ca4ccf83450f7b362b19d7 2023-07-11 21:25:40,290 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/eb1aa671864540d3864c8bd0db6ec834 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/eb1aa671864540d3864c8bd0db6ec834 2023-07-11 21:25:40,296 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/37d111b04b8b4f01a89d1b2a8fffb13f to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/37d111b04b8b4f01a89d1b2a8fffb13f 2023-07-11 21:25:40,298 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/0c9ea4047110484f9dec77f4a4d03e58 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/0c9ea4047110484f9dec77f4a4d03e58 2023-07-11 21:25:40,299 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/9c699202744848e0b548c57946d460be to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/9c699202744848e0b548c57946d460be 2023-07-11 21:25:40,313 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/de0b5c99831d46e7beac802b0ba07aa5 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/de0b5c99831d46e7beac802b0ba07aa5 2023-07-11 21:25:40,331 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/bce4da2c385346f8b19f6584f8efdd94 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/bce4da2c385346f8b19f6584f8efdd94 2023-07-11 21:25:40,334 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/d3bb818f46fc462baa772b0444065276 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/d3bb818f46fc462baa772b0444065276 2023-07-11 21:25:40,336 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/36f8a3d636fc4076adba569ef0440315 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/36f8a3d636fc4076adba569ef0440315 2023-07-11 21:25:40,344 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/f26744d379ab4d18a8e08c1789c18944 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/f26744d379ab4d18a8e08c1789c18944 2023-07-11 21:25:40,345 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/0f0243eabba145299c9f47a75147f2f8 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/0f0243eabba145299c9f47a75147f2f8 2023-07-11 21:25:40,348 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/c0a195505182467eb57cc2d06a647203 to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/c0a195505182467eb57cc2d06a647203 2023-07-11 21:25:40,350 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/a706222b2b9d48c5a4c354be28b8ed9f to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/a706222b2b9d48c5a4c354be28b8ed9f 2023-07-11 21:25:40,351 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/29b3be0b8a2f4eebaec0a3b59198683d to hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/archive/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/info/29b3be0b8a2f4eebaec0a3b59198683d 2023-07-11 21:25:40,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/default/TestLogRolling-testLogRolling/e9f7d63a9c90d49f5f03c967759a0923/recovered.edits/328.seqid, newMaxSeqId=328, maxSeqId=123 2023-07-11 21:25:40,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:25:40,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for e9f7d63a9c90d49f5f03c967759a0923: 2023-07-11 21:25:40,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,row0064,1689110657803.e9f7d63a9c90d49f5f03c967759a0923. 2023-07-11 21:25:40,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1242f002de3271c68d62a7e848a42bfa, disabling compactions & flushes 2023-07-11 21:25:40,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. 2023-07-11 21:25:40,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. 2023-07-11 21:25:40,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. after waiting 0 ms 2023-07-11 21:25:40,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. 2023-07-11 21:25:40,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/data/hbase/namespace/1242f002de3271c68d62a7e848a42bfa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:25:40,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. 2023-07-11 21:25:40,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1242f002de3271c68d62a7e848a42bfa: 2023-07-11 21:25:40,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689110622386.1242f002de3271c68d62a7e848a42bfa. 2023-07-11 21:25:40,430 INFO [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,42399,1689110621305; all regions closed. 2023-07-11 21:25:40,438 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/WALs/jenkins-hbase5.apache.org,42399,1689110621305/jenkins-hbase5.apache.org%2C42399%2C1689110621305.meta.1689110622312.meta not finished, retry = 0 2023-07-11 21:25:40,541 DEBUG [RS:0;jenkins-hbase5:42399] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/oldWALs 2023-07-11 21:25:40,541 INFO [RS:0;jenkins-hbase5:42399] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C42399%2C1689110621305.meta:.meta(num 1689110622312) 2023-07-11 21:25:40,547 DEBUG [RS:0;jenkins-hbase5:42399] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/oldWALs 2023-07-11 21:25:40,547 INFO [RS:0;jenkins-hbase5:42399] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C42399%2C1689110621305:(num 1689110740104) 2023-07-11 21:25:40,547 DEBUG [RS:0;jenkins-hbase5:42399] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:25:40,547 INFO [RS:0;jenkins-hbase5:42399] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:25:40,547 INFO [RS:0;jenkins-hbase5:42399] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 21:25:40,547 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 21:25:40,548 INFO [RS:0;jenkins-hbase5:42399] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:42399 2023-07-11 21:25:40,551 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:25:40,551 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,42399,1689110621305 2023-07-11 21:25:40,551 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:25:40,552 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,42399,1689110621305] 2023-07-11 21:25:40,552 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,42399,1689110621305; numProcessing=1 2023-07-11 21:25:40,555 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,42399,1689110621305 already deleted, retry=false 2023-07-11 21:25:40,555 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,42399,1689110621305 expired; onlineServers=0 2023-07-11 21:25:40,555 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,45467,1689110621237' ***** 2023-07-11 21:25:40,555 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 21:25:40,555 DEBUG [M:0;jenkins-hbase5:45467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a548746, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 21:25:40,555 INFO [M:0;jenkins-hbase5:45467] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,45467,1689110621237 2023-07-11 21:25:40,555 INFO [M:0;jenkins-hbase5:45467] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,45467,1689110621237; all regions closed. 2023-07-11 21:25:40,555 DEBUG [M:0;jenkins-hbase5:45467] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:25:40,555 DEBUG [M:0;jenkins-hbase5:45467] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 21:25:40,555 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 21:25:40,555 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689110621813] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689110621813,5,FailOnTimeoutGroup] 2023-07-11 21:25:40,555 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689110621814] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689110621814,5,FailOnTimeoutGroup] 2023-07-11 21:25:40,555 DEBUG [M:0;jenkins-hbase5:45467] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 21:25:40,557 INFO [M:0;jenkins-hbase5:45467] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 21:25:40,557 INFO [M:0;jenkins-hbase5:45467] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 21:25:40,557 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 21:25:40,557 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:40,557 INFO [M:0;jenkins-hbase5:45467] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-07-11 21:25:40,557 DEBUG [M:0;jenkins-hbase5:45467] master.HMaster(1512): Stopping service threads 2023-07-11 21:25:40,557 INFO [M:0;jenkins-hbase5:45467] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 21:25:40,557 ERROR [M:0;jenkins-hbase5:45467] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 21:25:40,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:25:40,557 INFO [M:0;jenkins-hbase5:45467] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 21:25:40,558 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 21:25:40,558 DEBUG [M:0;jenkins-hbase5:45467] zookeeper.ZKUtil(398): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 21:25:40,558 WARN [M:0;jenkins-hbase5:45467] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 21:25:40,558 INFO [M:0;jenkins-hbase5:45467] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 21:25:40,558 INFO [M:0;jenkins-hbase5:45467] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 21:25:40,559 DEBUG [M:0;jenkins-hbase5:45467] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 21:25:40,559 INFO [M:0;jenkins-hbase5:45467] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:25:40,559 DEBUG [M:0;jenkins-hbase5:45467] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:25:40,559 DEBUG [M:0;jenkins-hbase5:45467] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 21:25:40,559 DEBUG [M:0;jenkins-hbase5:45467] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:25:40,559 INFO [M:0;jenkins-hbase5:45467] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=64.70 KB heapSize=78.42 KB 2023-07-11 21:25:40,584 INFO [M:0;jenkins-hbase5:45467] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64.70 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e7262c71c4ad4e92a000e95292689b14 2023-07-11 21:25:40,590 INFO [M:0;jenkins-hbase5:45467] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7262c71c4ad4e92a000e95292689b14 2023-07-11 21:25:40,591 DEBUG [M:0;jenkins-hbase5:45467] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e7262c71c4ad4e92a000e95292689b14 as hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e7262c71c4ad4e92a000e95292689b14 2023-07-11 21:25:40,597 INFO [M:0;jenkins-hbase5:45467] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7262c71c4ad4e92a000e95292689b14 2023-07-11 21:25:40,597 INFO [M:0;jenkins-hbase5:45467] regionserver.HStore(1080): Added hdfs://localhost:36251/user/jenkins/test-data/40af578b-458f-27f2-fb4d-2baa34fb010c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e7262c71c4ad4e92a000e95292689b14, entries=18, sequenceid=160, filesize=6.9 K 2023-07-11 21:25:40,598 INFO [M:0;jenkins-hbase5:45467] regionserver.HRegion(2948): Finished flush of dataSize ~64.70 KB/66256, heapSize ~78.41 KB/80288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 39ms, sequenceid=160, compaction requested=false 2023-07-11 21:25:40,600 INFO [M:0;jenkins-hbase5:45467] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:25:40,600 DEBUG [M:0;jenkins-hbase5:45467] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:25:40,603 INFO [M:0;jenkins-hbase5:45467] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 21:25:40,603 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 21:25:40,603 INFO [M:0;jenkins-hbase5:45467] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:45467 2023-07-11 21:25:40,606 DEBUG [M:0;jenkins-hbase5:45467] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,45467,1689110621237 already deleted, retry=false 2023-07-11 21:25:40,652 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:25:40,652 INFO [RS:0;jenkins-hbase5:42399] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,42399,1689110621305; zookeeper connection closed. 2023-07-11 21:25:40,653 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): regionserver:42399-0x101c1e1764f0001, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:25:40,653 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7f0aeaa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7f0aeaa 2023-07-11 21:25:40,654 INFO [Listener at localhost/39973] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-11 21:25:40,753 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:25:40,753 INFO [M:0;jenkins-hbase5:45467] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,45467,1689110621237; zookeeper connection closed. 2023-07-11 21:25:40,753 DEBUG [Listener at localhost/39973-EventThread] zookeeper.ZKWatcher(600): master:45467-0x101c1e1764f0000, quorum=127.0.0.1:62565, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:25:40,754 WARN [Listener at localhost/39973] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:25:40,758 INFO [Listener at localhost/39973] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:25:40,865 WARN [BP-1805327430-172.31.10.131-1689110620184 heartbeating to localhost/127.0.0.1:36251] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:25:40,865 WARN [BP-1805327430-172.31.10.131-1689110620184 heartbeating to localhost/127.0.0.1:36251] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1805327430-172.31.10.131-1689110620184 (Datanode Uuid 467c733c-f684-4c63-a6d2-19a1d50922d1) service to localhost/127.0.0.1:36251 2023-07-11 21:25:40,866 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/cluster_b87950ca-26f6-73dd-816a-10ee8e9fd3bc/dfs/data/data3/current/BP-1805327430-172.31.10.131-1689110620184] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:25:40,866 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/cluster_b87950ca-26f6-73dd-816a-10ee8e9fd3bc/dfs/data/data4/current/BP-1805327430-172.31.10.131-1689110620184] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:25:40,868 WARN [Listener at localhost/39973] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:25:40,872 INFO [Listener at localhost/39973] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:25:40,976 WARN [BP-1805327430-172.31.10.131-1689110620184 heartbeating to localhost/127.0.0.1:36251] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:25:40,976 WARN [BP-1805327430-172.31.10.131-1689110620184 heartbeating to localhost/127.0.0.1:36251] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1805327430-172.31.10.131-1689110620184 (Datanode Uuid ed89530d-a026-4961-8394-39b068907b63) service to localhost/127.0.0.1:36251 2023-07-11 21:25:40,977 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/cluster_b87950ca-26f6-73dd-816a-10ee8e9fd3bc/dfs/data/data1/current/BP-1805327430-172.31.10.131-1689110620184] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:25:40,977 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/cluster_b87950ca-26f6-73dd-816a-10ee8e9fd3bc/dfs/data/data2/current/BP-1805327430-172.31.10.131-1689110620184] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:25:40,992 INFO [Listener at localhost/39973] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:25:41,117 INFO [Listener at localhost/39973] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 21:25:41,161 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-11 21:25:41,177 INFO [Listener at localhost/39973] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=76 (was 65) - Thread LEAK? -, OpenFileDescriptor=460 (was 438) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=465 (was 399) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 173), AvailableMemoryMB=2532 (was 3480) 2023-07-11 21:25:41,195 INFO [Listener at localhost/39973] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=77, OpenFileDescriptor=460, MaxFileDescriptor=60000, SystemLoadAverage=465, ProcessCount=169, AvailableMemoryMB=2532 2023-07-11 21:25:41,195 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 21:25:41,195 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/hadoop.log.dir so I do NOT create it in target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5 2023-07-11 21:25:41,195 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/aa04076b-6403-7caa-b560-776393c0aa8a/hadoop.tmp.dir so I do NOT create it in target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5 2023-07-11 21:25:41,196 INFO [Listener at localhost/39973] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/cluster_ac787357-0e5f-de7c-9d68-8ad1874d8168, deleteOnExit=true 2023-07-11 21:25:41,196 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 21:25:41,196 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/test.cache.data in system properties and HBase conf 2023-07-11 21:25:41,196 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 21:25:41,196 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/hadoop.log.dir in system properties and HBase conf 2023-07-11 21:25:41,196 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 21:25:41,197 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 21:25:41,197 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 21:25:41,197 DEBUG [Listener at localhost/39973] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 21:25:41,197 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:25:41,197 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 21:25:41,198 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 21:25:41,198 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:25:41,198 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 21:25:41,198 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 21:25:41,198 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 21:25:41,199 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:25:41,199 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 21:25:41,199 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/nfs.dump.dir in system properties and HBase conf 2023-07-11 21:25:41,199 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/java.io.tmpdir in system properties and HBase conf 2023-07-11 21:25:41,199 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 21:25:41,199 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 21:25:41,200 INFO [Listener at localhost/39973] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 21:25:41,204 WARN [Listener at localhost/39973] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 21:25:41,205 WARN [Listener at localhost/39973] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 21:25:41,277 WARN [Listener at localhost/39973] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:25:41,280 INFO [Listener at localhost/39973] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:25:41,286 INFO [Listener at localhost/39973] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/java.io.tmpdir/Jetty_localhost_35871_hdfs____.h7qbc6/webapp 2023-07-11 21:25:41,418 INFO [Listener at localhost/39973] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35871 2023-07-11 21:25:41,419 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:25:41,423 WARN [Listener at localhost/39973] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 21:25:41,423 WARN [Listener at localhost/39973] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 21:25:41,475 WARN [Listener at localhost/42949] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:25:41,486 WARN [Listener at localhost/42949] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:25:41,488 WARN [Listener at localhost/42949] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:25:41,490 INFO [Listener at localhost/42949] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:25:41,494 INFO [Listener at localhost/42949] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/java.io.tmpdir/Jetty_localhost_42003_datanode____.iay0mc/webapp 2023-07-11 21:25:41,594 INFO [Listener at localhost/42949] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42003 2023-07-11 21:25:41,600 WARN [Listener at localhost/39945] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:25:41,613 WARN [Listener at localhost/39945] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 21:25:41,615 WARN [Listener at localhost/39945] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 21:25:41,616 INFO [Listener at localhost/39945] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 21:25:41,620 INFO [Listener at localhost/39945] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/java.io.tmpdir/Jetty_localhost_44203_datanode____eo92u4/webapp 2023-07-11 21:25:41,731 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8402e19f98ea44a9: Processing first storage report for DS-54c3e1cf-d273-4ccd-94e0-dd3e620896d8 from datanode 93cd066d-ea70-405b-b658-74fe84a6b613 2023-07-11 21:25:41,731 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8402e19f98ea44a9: from storage DS-54c3e1cf-d273-4ccd-94e0-dd3e620896d8 node DatanodeRegistration(127.0.0.1:35339, datanodeUuid=93cd066d-ea70-405b-b658-74fe84a6b613, infoPort=36291, infoSecurePort=0, ipcPort=39945, storageInfo=lv=-57;cid=testClusterID;nsid=340690492;c=1689110741207), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:25:41,732 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8402e19f98ea44a9: Processing first storage report for DS-85994e05-f949-481c-a81f-beea008f9f8c from datanode 93cd066d-ea70-405b-b658-74fe84a6b613 2023-07-11 21:25:41,732 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8402e19f98ea44a9: from storage DS-85994e05-f949-481c-a81f-beea008f9f8c node DatanodeRegistration(127.0.0.1:35339, datanodeUuid=93cd066d-ea70-405b-b658-74fe84a6b613, infoPort=36291, infoSecurePort=0, ipcPort=39945, storageInfo=lv=-57;cid=testClusterID;nsid=340690492;c=1689110741207), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:25:41,741 INFO [Listener at localhost/39945] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44203 2023-07-11 21:25:41,755 WARN [Listener at localhost/46523] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 21:25:41,856 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6281a66b8974aec0: Processing first storage report for DS-4da330b9-84ef-41cd-8ede-ce8b11252a86 from datanode 2491b02c-f239-4fea-90a3-ac2d809318ab 2023-07-11 21:25:41,856 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6281a66b8974aec0: from storage DS-4da330b9-84ef-41cd-8ede-ce8b11252a86 node DatanodeRegistration(127.0.0.1:40531, datanodeUuid=2491b02c-f239-4fea-90a3-ac2d809318ab, infoPort=44861, infoSecurePort=0, ipcPort=46523, storageInfo=lv=-57;cid=testClusterID;nsid=340690492;c=1689110741207), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:25:41,856 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6281a66b8974aec0: Processing first storage report for DS-2947f5c9-69a0-4ee3-9f83-4eceec463d24 from datanode 2491b02c-f239-4fea-90a3-ac2d809318ab 2023-07-11 21:25:41,856 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6281a66b8974aec0: from storage DS-2947f5c9-69a0-4ee3-9f83-4eceec463d24 node DatanodeRegistration(127.0.0.1:40531, datanodeUuid=2491b02c-f239-4fea-90a3-ac2d809318ab, infoPort=44861, infoSecurePort=0, ipcPort=46523, storageInfo=lv=-57;cid=testClusterID;nsid=340690492;c=1689110741207), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 21:25:41,862 DEBUG [Listener at localhost/46523] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5 2023-07-11 21:25:41,865 INFO [Listener at localhost/46523] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/cluster_ac787357-0e5f-de7c-9d68-8ad1874d8168/zookeeper_0, clientPort=50879, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/cluster_ac787357-0e5f-de7c-9d68-8ad1874d8168/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/cluster_ac787357-0e5f-de7c-9d68-8ad1874d8168/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 21:25:41,866 INFO [Listener at localhost/46523] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50879 2023-07-11 21:25:41,867 INFO [Listener at localhost/46523] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:25:41,868 INFO [Listener at localhost/46523] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:25:41,881 INFO [Listener at localhost/46523] util.FSUtils(471): Created version file at hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e with version=8 2023-07-11 21:25:41,881 INFO [Listener at localhost/46523] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:33063/user/jenkins/test-data/db7971b3-0b2f-8716-6cf4-223b3d67c2b1/hbase-staging 2023-07-11 21:25:41,882 INFO [Listener at localhost/46523] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 21:25:41,883 INFO [Listener at localhost/46523] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:25:41,883 INFO [Listener at localhost/46523] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:25:41,883 INFO [Listener at localhost/46523] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:25:41,883 INFO [Listener at localhost/46523] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:25:41,883 INFO [Listener at localhost/46523] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:25:41,883 INFO [Listener at localhost/46523] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:25:41,884 INFO [Listener at localhost/46523] ipc.NettyRpcServer(120): Bind to /172.31.10.131:40583 2023-07-11 21:25:41,885 INFO [Listener at localhost/46523] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:25:41,886 INFO [Listener at localhost/46523] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:25:41,887 INFO [Listener at localhost/46523] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40583 connecting to ZooKeeper ensemble=127.0.0.1:50879 2023-07-11 21:25:41,895 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:405830x0, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:25:41,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40583-0x101c1e34dc40000 connected 2023-07-11 21:25:41,909 DEBUG [Listener at localhost/46523] zookeeper.ZKUtil(164): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:25:41,909 DEBUG [Listener at localhost/46523] zookeeper.ZKUtil(164): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:25:41,909 DEBUG [Listener at localhost/46523] zookeeper.ZKUtil(164): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:25:41,910 DEBUG [Listener at localhost/46523] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40583 2023-07-11 21:25:41,910 DEBUG [Listener at localhost/46523] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40583 2023-07-11 21:25:41,910 DEBUG [Listener at localhost/46523] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40583 2023-07-11 21:25:41,911 DEBUG [Listener at localhost/46523] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40583 2023-07-11 21:25:41,911 DEBUG [Listener at localhost/46523] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40583 2023-07-11 21:25:41,911 INFO [Listener at localhost/46523] master.HMaster(444): hbase.rootdir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e, hbase.cluster.distributed=false 2023-07-11 21:25:41,924 INFO [Listener at localhost/46523] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-11 21:25:41,924 INFO [Listener at localhost/46523] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:25:41,924 INFO [Listener at localhost/46523] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 21:25:41,924 INFO [Listener at localhost/46523] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 21:25:41,924 INFO [Listener at localhost/46523] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 21:25:41,924 INFO [Listener at localhost/46523] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 21:25:41,924 INFO [Listener at localhost/46523] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 21:25:41,926 INFO [Listener at localhost/46523] ipc.NettyRpcServer(120): Bind to /172.31.10.131:46217 2023-07-11 21:25:41,927 INFO [Listener at localhost/46523] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 21:25:41,927 DEBUG [Listener at localhost/46523] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 21:25:41,928 INFO [Listener at localhost/46523] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:25:41,929 INFO [Listener at localhost/46523] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:25:41,930 INFO [Listener at localhost/46523] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46217 connecting to ZooKeeper ensemble=127.0.0.1:50879 2023-07-11 21:25:41,932 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): regionserver:462170x0, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 21:25:41,933 DEBUG [Listener at localhost/46523] zookeeper.ZKUtil(164): regionserver:462170x0, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:25:41,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46217-0x101c1e34dc40001 connected 2023-07-11 21:25:41,934 DEBUG [Listener at localhost/46523] zookeeper.ZKUtil(164): regionserver:46217-0x101c1e34dc40001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:25:41,935 DEBUG [Listener at localhost/46523] zookeeper.ZKUtil(164): regionserver:46217-0x101c1e34dc40001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 21:25:41,935 DEBUG [Listener at localhost/46523] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46217 2023-07-11 21:25:41,935 DEBUG [Listener at localhost/46523] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46217 2023-07-11 21:25:41,936 DEBUG [Listener at localhost/46523] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46217 2023-07-11 21:25:41,936 DEBUG [Listener at localhost/46523] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46217 2023-07-11 21:25:41,936 DEBUG [Listener at localhost/46523] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46217 2023-07-11 21:25:41,937 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,40583,1689110741882 2023-07-11 21:25:41,938 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 21:25:41,939 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,40583,1689110741882 2023-07-11 21:25:41,940 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:25:41,940 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x101c1e34dc40001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 21:25:41,940 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:41,940 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 21:25:41,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 21:25:41,941 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,40583,1689110741882 from backup master directory 2023-07-11 21:25:41,944 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,40583,1689110741882 2023-07-11 21:25:41,944 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 21:25:41,944 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:25:41,944 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,40583,1689110741882 2023-07-11 21:25:41,955 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/hbase.id with ID: 8aa32f20-e078-45c2-8651-e7f6830a2568 2023-07-11 21:25:41,972 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:25:41,973 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:25:41,975 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:41,983 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2bf6c55c to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:25:41,986 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ed68679, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:25:41,987 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 21:25:41,987 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 21:25:41,987 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:25:41,989 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/data/master/store-tmp 2023-07-11 21:25:41,996 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:25:41,996 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 21:25:41,996 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:25:41,996 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:25:41,996 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 21:25:41,996 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:25:41,996 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:25:41,996 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:25:41,997 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/WALs/jenkins-hbase5.apache.org,40583,1689110741882 2023-07-11 21:25:41,999 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C40583%2C1689110741882, suffix=, logDir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/WALs/jenkins-hbase5.apache.org,40583,1689110741882, archiveDir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/oldWALs, maxLogs=10 2023-07-11 21:25:42,013 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35339,DS-54c3e1cf-d273-4ccd-94e0-dd3e620896d8,DISK] 2023-07-11 21:25:42,014 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40531,DS-4da330b9-84ef-41cd-8ede-ce8b11252a86,DISK] 2023-07-11 21:25:42,016 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/WALs/jenkins-hbase5.apache.org,40583,1689110741882/jenkins-hbase5.apache.org%2C40583%2C1689110741882.1689110741999 2023-07-11 21:25:42,016 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35339,DS-54c3e1cf-d273-4ccd-94e0-dd3e620896d8,DISK], DatanodeInfoWithStorage[127.0.0.1:40531,DS-4da330b9-84ef-41cd-8ede-ce8b11252a86,DISK]] 2023-07-11 21:25:42,016 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:25:42,017 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:25:42,017 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:25:42,017 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:25:42,018 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:25:42,019 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 21:25:42,020 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 21:25:42,020 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:25:42,021 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:25:42,022 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:25:42,024 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 21:25:42,025 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:25:42,026 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=774549, jitterRate=-0.015111252665519714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:25:42,026 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:25:42,026 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 21:25:42,027 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 21:25:42,027 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 21:25:42,027 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 21:25:42,027 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 21:25:42,028 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-11 21:25:42,028 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 21:25:42,028 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 21:25:42,029 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 21:25:42,039 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 21:25:42,039 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 21:25:42,040 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 21:25:42,040 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 21:25:42,040 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 21:25:42,042 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:42,042 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 21:25:42,043 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 21:25:42,044 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 21:25:42,046 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:25:42,046 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x101c1e34dc40001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 21:25:42,046 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:42,047 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,40583,1689110741882, sessionid=0x101c1e34dc40000, setting cluster-up flag (Was=false) 2023-07-11 21:25:42,050 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:42,055 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 21:25:42,056 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,40583,1689110741882 2023-07-11 21:25:42,058 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:42,062 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 21:25:42,063 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,40583,1689110741882 2023-07-11 21:25:42,064 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/.hbase-snapshot/.tmp 2023-07-11 21:25:42,068 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 21:25:42,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:25:42,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:25:42,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:25:42,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-11 21:25:42,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-07-11 21:25:42,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:25:42,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:25:42,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:25:42,070 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689110772070 2023-07-11 21:25:42,071 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 21:25:42,071 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 21:25:42,071 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 21:25:42,071 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 21:25:42,071 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 21:25:42,071 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 21:25:42,071 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,071 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 21:25:42,072 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 21:25:42,072 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 21:25:42,072 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 21:25:42,072 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 21:25:42,073 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 21:25:42,073 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 21:25:42,073 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689110742073,5,FailOnTimeoutGroup] 2023-07-11 21:25:42,073 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689110742073,5,FailOnTimeoutGroup] 2023-07-11 21:25:42,073 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,073 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 21:25:42,073 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,073 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:25:42,073 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,082 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 21:25:42,083 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 21:25:42,083 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e 2023-07-11 21:25:42,092 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:25:42,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 21:25:42,094 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/info 2023-07-11 21:25:42,094 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 21:25:42,095 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:25:42,095 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 21:25:42,096 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:25:42,096 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 21:25:42,097 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:25:42,097 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 21:25:42,098 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/table 2023-07-11 21:25:42,098 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 21:25:42,099 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:25:42,099 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740 2023-07-11 21:25:42,100 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740 2023-07-11 21:25:42,102 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-11 21:25:42,103 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 21:25:42,105 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:25:42,105 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=723575, jitterRate=-0.07992789149284363}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-11 21:25:42,105 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 21:25:42,105 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 21:25:42,105 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 21:25:42,105 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 21:25:42,105 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 21:25:42,105 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 21:25:42,105 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 21:25:42,106 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 21:25:42,106 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 21:25:42,106 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 21:25:42,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 21:25:42,108 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 21:25:42,108 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 21:25:42,137 INFO [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(951): ClusterId : 8aa32f20-e078-45c2-8651-e7f6830a2568 2023-07-11 21:25:42,138 DEBUG [RS:0;jenkins-hbase5:46217] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 21:25:42,140 DEBUG [RS:0;jenkins-hbase5:46217] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 21:25:42,140 DEBUG [RS:0;jenkins-hbase5:46217] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 21:25:42,142 DEBUG [RS:0;jenkins-hbase5:46217] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 21:25:42,143 DEBUG [RS:0;jenkins-hbase5:46217] zookeeper.ReadOnlyZKClient(139): Connect 0x36ed04c7 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:25:42,147 DEBUG [RS:0;jenkins-hbase5:46217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@382aec6a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:25:42,147 DEBUG [RS:0;jenkins-hbase5:46217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c156fb7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 21:25:42,156 DEBUG [RS:0;jenkins-hbase5:46217] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:46217 2023-07-11 21:25:42,156 INFO [RS:0;jenkins-hbase5:46217] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 21:25:42,156 INFO [RS:0;jenkins-hbase5:46217] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 21:25:42,156 DEBUG [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 21:25:42,157 INFO [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,40583,1689110741882 with isa=jenkins-hbase5.apache.org/172.31.10.131:46217, startcode=1689110741923 2023-07-11 21:25:42,157 DEBUG [RS:0;jenkins-hbase5:46217] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 21:25:42,160 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:33905, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 21:25:42,160 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40583] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,46217,1689110741923 2023-07-11 21:25:42,161 DEBUG [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e 2023-07-11 21:25:42,161 DEBUG [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42949 2023-07-11 21:25:42,161 DEBUG [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 21:25:42,162 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:25:42,162 DEBUG [RS:0;jenkins-hbase5:46217] zookeeper.ZKUtil(162): regionserver:46217-0x101c1e34dc40001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,46217,1689110741923 2023-07-11 21:25:42,163 WARN [RS:0;jenkins-hbase5:46217] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 21:25:42,163 INFO [RS:0;jenkins-hbase5:46217] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:25:42,163 DEBUG [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/WALs/jenkins-hbase5.apache.org,46217,1689110741923 2023-07-11 21:25:42,163 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,46217,1689110741923] 2023-07-11 21:25:42,166 DEBUG [RS:0;jenkins-hbase5:46217] zookeeper.ZKUtil(162): regionserver:46217-0x101c1e34dc40001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,46217,1689110741923 2023-07-11 21:25:42,167 DEBUG [RS:0;jenkins-hbase5:46217] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 21:25:42,167 INFO [RS:0;jenkins-hbase5:46217] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 21:25:42,168 INFO [RS:0;jenkins-hbase5:46217] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 21:25:42,168 INFO [RS:0;jenkins-hbase5:46217] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 21:25:42,168 INFO [RS:0;jenkins-hbase5:46217] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,169 INFO [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 21:25:42,169 INFO [RS:0;jenkins-hbase5:46217] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,170 DEBUG [RS:0;jenkins-hbase5:46217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:25:42,170 DEBUG [RS:0;jenkins-hbase5:46217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:25:42,170 DEBUG [RS:0;jenkins-hbase5:46217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:25:42,170 DEBUG [RS:0;jenkins-hbase5:46217] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:25:42,170 DEBUG [RS:0;jenkins-hbase5:46217] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:25:42,170 DEBUG [RS:0;jenkins-hbase5:46217] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-11 21:25:42,170 DEBUG [RS:0;jenkins-hbase5:46217] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:25:42,170 DEBUG [RS:0;jenkins-hbase5:46217] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:25:42,170 DEBUG [RS:0;jenkins-hbase5:46217] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:25:42,170 DEBUG [RS:0;jenkins-hbase5:46217] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-11 21:25:42,171 INFO [RS:0;jenkins-hbase5:46217] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,171 INFO [RS:0;jenkins-hbase5:46217] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,171 INFO [RS:0;jenkins-hbase5:46217] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,182 INFO [RS:0;jenkins-hbase5:46217] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 21:25:42,182 INFO [RS:0;jenkins-hbase5:46217] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,46217,1689110741923-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,194 INFO [RS:0;jenkins-hbase5:46217] regionserver.Replication(203): jenkins-hbase5.apache.org,46217,1689110741923 started 2023-07-11 21:25:42,195 INFO [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,46217,1689110741923, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:46217, sessionid=0x101c1e34dc40001 2023-07-11 21:25:42,195 DEBUG [RS:0;jenkins-hbase5:46217] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 21:25:42,195 DEBUG [RS:0;jenkins-hbase5:46217] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,46217,1689110741923 2023-07-11 21:25:42,195 DEBUG [RS:0;jenkins-hbase5:46217] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,46217,1689110741923' 2023-07-11 21:25:42,195 DEBUG [RS:0;jenkins-hbase5:46217] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 21:25:42,195 DEBUG [RS:0;jenkins-hbase5:46217] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 21:25:42,196 DEBUG [RS:0;jenkins-hbase5:46217] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 21:25:42,196 DEBUG [RS:0;jenkins-hbase5:46217] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 21:25:42,196 DEBUG [RS:0;jenkins-hbase5:46217] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,46217,1689110741923 2023-07-11 21:25:42,196 DEBUG [RS:0;jenkins-hbase5:46217] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,46217,1689110741923' 2023-07-11 21:25:42,196 DEBUG [RS:0;jenkins-hbase5:46217] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 21:25:42,197 DEBUG [RS:0;jenkins-hbase5:46217] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 21:25:42,197 DEBUG [RS:0;jenkins-hbase5:46217] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 21:25:42,197 INFO [RS:0;jenkins-hbase5:46217] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 21:25:42,197 INFO [RS:0;jenkins-hbase5:46217] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 21:25:42,259 DEBUG [jenkins-hbase5:40583] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-11 21:25:42,260 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,46217,1689110741923, state=OPENING 2023-07-11 21:25:42,261 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 21:25:42,264 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:42,264 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 21:25:42,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,46217,1689110741923}] 2023-07-11 21:25:42,299 INFO [RS:0;jenkins-hbase5:46217] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C46217%2C1689110741923, suffix=, logDir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/WALs/jenkins-hbase5.apache.org,46217,1689110741923, archiveDir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/oldWALs, maxLogs=32 2023-07-11 21:25:42,317 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35339,DS-54c3e1cf-d273-4ccd-94e0-dd3e620896d8,DISK] 2023-07-11 21:25:42,317 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40531,DS-4da330b9-84ef-41cd-8ede-ce8b11252a86,DISK] 2023-07-11 21:25:42,319 INFO [RS:0;jenkins-hbase5:46217] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/WALs/jenkins-hbase5.apache.org,46217,1689110741923/jenkins-hbase5.apache.org%2C46217%2C1689110741923.1689110742300 2023-07-11 21:25:42,319 DEBUG [RS:0;jenkins-hbase5:46217] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35339,DS-54c3e1cf-d273-4ccd-94e0-dd3e620896d8,DISK], DatanodeInfoWithStorage[127.0.0.1:40531,DS-4da330b9-84ef-41cd-8ede-ce8b11252a86,DISK]] 2023-07-11 21:25:42,418 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,46217,1689110741923 2023-07-11 21:25:42,418 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 21:25:42,420 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:56566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 21:25:42,424 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 21:25:42,424 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:25:42,425 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C46217%2C1689110741923.meta, suffix=.meta, logDir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/WALs/jenkins-hbase5.apache.org,46217,1689110741923, archiveDir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/oldWALs, maxLogs=32 2023-07-11 21:25:42,440 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35339,DS-54c3e1cf-d273-4ccd-94e0-dd3e620896d8,DISK] 2023-07-11 21:25:42,440 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40531,DS-4da330b9-84ef-41cd-8ede-ce8b11252a86,DISK] 2023-07-11 21:25:42,442 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/WALs/jenkins-hbase5.apache.org,46217,1689110741923/jenkins-hbase5.apache.org%2C46217%2C1689110741923.meta.1689110742426.meta 2023-07-11 21:25:42,442 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35339,DS-54c3e1cf-d273-4ccd-94e0-dd3e620896d8,DISK], DatanodeInfoWithStorage[127.0.0.1:40531,DS-4da330b9-84ef-41cd-8ede-ce8b11252a86,DISK]] 2023-07-11 21:25:42,442 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:25:42,443 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 21:25:42,443 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 21:25:42,443 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 21:25:42,443 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 21:25:42,443 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:25:42,443 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 21:25:42,443 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 21:25:42,445 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 21:25:42,446 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/info 2023-07-11 21:25:42,446 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/info 2023-07-11 21:25:42,446 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 21:25:42,447 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:25:42,447 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 21:25:42,448 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:25:42,448 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/rep_barrier 2023-07-11 21:25:42,448 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 21:25:42,448 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:25:42,449 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 21:25:42,449 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/table 2023-07-11 21:25:42,449 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/table 2023-07-11 21:25:42,450 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 21:25:42,450 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:25:42,451 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740 2023-07-11 21:25:42,452 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740 2023-07-11 21:25:42,454 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-11 21:25:42,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 21:25:42,456 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=741209, jitterRate=-0.05750429630279541}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-11 21:25:42,456 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 21:25:42,457 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689110742418 2023-07-11 21:25:42,461 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 21:25:42,461 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 21:25:42,461 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,46217,1689110741923, state=OPEN 2023-07-11 21:25:42,463 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 21:25:42,463 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 21:25:42,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 21:25:42,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,46217,1689110741923 in 199 msec 2023-07-11 21:25:42,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 21:25:42,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 358 msec 2023-07-11 21:25:42,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-07-11 21:25:42,467 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689110742467, completionTime=-1 2023-07-11 21:25:42,467 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-11 21:25:42,468 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 21:25:42,470 DEBUG [hconnection-0x1080a518-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:25:42,472 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:56572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:25:42,473 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-11 21:25:42,473 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689110802473 2023-07-11 21:25:42,473 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689110862473 2023-07-11 21:25:42,473 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-07-11 21:25:42,478 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,40583,1689110741882-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,478 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,40583,1689110741882-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,478 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,40583,1689110741882-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,478 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:40583, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,478 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 21:25:42,479 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 21:25:42,479 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 21:25:42,480 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 21:25:42,481 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 21:25:42,481 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 21:25:42,481 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 21:25:42,483 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/.tmp/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176 2023-07-11 21:25:42,484 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/.tmp/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176 empty. 2023-07-11 21:25:42,484 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/.tmp/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176 2023-07-11 21:25:42,484 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 21:25:42,494 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 21:25:42,495 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 63a91e11c003da1ea7815624bdeff176, NAME => 'hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/.tmp 2023-07-11 21:25:42,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:25:42,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 63a91e11c003da1ea7815624bdeff176, disabling compactions & flushes 2023-07-11 21:25:42,502 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. 2023-07-11 21:25:42,503 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. 2023-07-11 21:25:42,503 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. after waiting 0 ms 2023-07-11 21:25:42,503 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. 2023-07-11 21:25:42,503 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. 2023-07-11 21:25:42,503 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 63a91e11c003da1ea7815624bdeff176: 2023-07-11 21:25:42,505 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 21:25:42,506 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689110742506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689110742506"}]},"ts":"1689110742506"} 2023-07-11 21:25:42,507 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 21:25:42,508 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 21:25:42,508 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110742508"}]},"ts":"1689110742508"} 2023-07-11 21:25:42,509 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 21:25:42,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=63a91e11c003da1ea7815624bdeff176, ASSIGN}] 2023-07-11 21:25:42,518 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=63a91e11c003da1ea7815624bdeff176, ASSIGN 2023-07-11 21:25:42,518 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=63a91e11c003da1ea7815624bdeff176, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,46217,1689110741923; forceNewPlan=false, retain=false 2023-07-11 21:25:42,670 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=63a91e11c003da1ea7815624bdeff176, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,46217,1689110741923 2023-07-11 21:25:42,670 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689110742669"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689110742669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689110742669"}]},"ts":"1689110742669"} 2023-07-11 21:25:42,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 63a91e11c003da1ea7815624bdeff176, server=jenkins-hbase5.apache.org,46217,1689110741923}] 2023-07-11 21:25:42,828 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. 2023-07-11 21:25:42,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 63a91e11c003da1ea7815624bdeff176, NAME => 'hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176.', STARTKEY => '', ENDKEY => ''} 2023-07-11 21:25:42,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 63a91e11c003da1ea7815624bdeff176 2023-07-11 21:25:42,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 21:25:42,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 63a91e11c003da1ea7815624bdeff176 2023-07-11 21:25:42,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 63a91e11c003da1ea7815624bdeff176 2023-07-11 21:25:42,833 INFO [StoreOpener-63a91e11c003da1ea7815624bdeff176-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 63a91e11c003da1ea7815624bdeff176 2023-07-11 21:25:42,835 DEBUG [StoreOpener-63a91e11c003da1ea7815624bdeff176-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176/info 2023-07-11 21:25:42,835 DEBUG [StoreOpener-63a91e11c003da1ea7815624bdeff176-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176/info 2023-07-11 21:25:42,835 INFO [StoreOpener-63a91e11c003da1ea7815624bdeff176-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63a91e11c003da1ea7815624bdeff176 columnFamilyName info 2023-07-11 21:25:42,835 INFO [StoreOpener-63a91e11c003da1ea7815624bdeff176-1] regionserver.HStore(310): Store=63a91e11c003da1ea7815624bdeff176/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 21:25:42,836 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176 2023-07-11 21:25:42,837 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176 2023-07-11 21:25:42,840 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 63a91e11c003da1ea7815624bdeff176 2023-07-11 21:25:42,842 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 21:25:42,843 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 63a91e11c003da1ea7815624bdeff176; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=789227, jitterRate=0.0035544931888580322}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 21:25:42,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 63a91e11c003da1ea7815624bdeff176: 2023-07-11 21:25:42,844 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176., pid=6, masterSystemTime=1689110742824 2023-07-11 21:25:42,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. 2023-07-11 21:25:42,845 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. 2023-07-11 21:25:42,845 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=63a91e11c003da1ea7815624bdeff176, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,46217,1689110741923 2023-07-11 21:25:42,846 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689110742845"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689110742845"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689110742845"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689110742845"}]},"ts":"1689110742845"} 2023-07-11 21:25:42,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 21:25:42,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 63a91e11c003da1ea7815624bdeff176, server=jenkins-hbase5.apache.org,46217,1689110741923 in 176 msec 2023-07-11 21:25:42,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 21:25:42,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=63a91e11c003da1ea7815624bdeff176, ASSIGN in 332 msec 2023-07-11 21:25:42,851 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 21:25:42,851 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689110742851"}]},"ts":"1689110742851"} 2023-07-11 21:25:42,852 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 21:25:42,854 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 21:25:42,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 375 msec 2023-07-11 21:25:42,881 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 21:25:42,883 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:25:42,883 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:42,887 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 21:25:42,893 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:25:42,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 7 msec 2023-07-11 21:25:42,898 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 21:25:42,904 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 21:25:42,907 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-07-11 21:25:42,912 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 21:25:42,915 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 21:25:42,916 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.972sec 2023-07-11 21:25:42,916 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 21:25:42,916 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 21:25:42,916 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 21:25:42,916 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,40583,1689110741882-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 21:25:42,916 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,40583,1689110741882-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 21:25:42,917 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 21:25:42,938 DEBUG [Listener at localhost/46523] zookeeper.ReadOnlyZKClient(139): Connect 0x3ee2c61f to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 21:25:42,944 DEBUG [Listener at localhost/46523] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13d9da3b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 21:25:42,945 DEBUG [hconnection-0x2848e8a8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 21:25:42,947 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:56574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 21:25:42,949 INFO [Listener at localhost/46523] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,40583,1689110741882 2023-07-11 21:25:42,949 INFO [Listener at localhost/46523] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 21:25:42,952 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-11 21:25:42,952 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:42,953 INFO [Listener at localhost/46523] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-11 21:25:42,953 INFO [Listener at localhost/46523] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 21:25:42,956 INFO [Listener at localhost/46523] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=test.com%2C8080%2C1, suffix=, logDir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/WALs/test.com,8080,1, archiveDir=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/oldWALs, maxLogs=32 2023-07-11 21:25:42,971 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40531,DS-4da330b9-84ef-41cd-8ede-ce8b11252a86,DISK] 2023-07-11 21:25:42,972 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35339,DS-54c3e1cf-d273-4ccd-94e0-dd3e620896d8,DISK] 2023-07-11 21:25:42,973 INFO [Listener at localhost/46523] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/WALs/test.com,8080,1/test.com%2C8080%2C1.1689110742956 2023-07-11 21:25:42,974 DEBUG [Listener at localhost/46523] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40531,DS-4da330b9-84ef-41cd-8ede-ce8b11252a86,DISK], DatanodeInfoWithStorage[127.0.0.1:35339,DS-54c3e1cf-d273-4ccd-94e0-dd3e620896d8,DISK]] 2023-07-11 21:25:42,989 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35339,DS-54c3e1cf-d273-4ccd-94e0-dd3e620896d8,DISK] 2023-07-11 21:25:42,989 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40531,DS-4da330b9-84ef-41cd-8ede-ce8b11252a86,DISK] 2023-07-11 21:25:42,991 INFO [Listener at localhost/46523] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/WALs/test.com,8080,1/test.com%2C8080%2C1.1689110742956 with entries=0, filesize=83 B; new WAL /user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/WALs/test.com,8080,1/test.com%2C8080%2C1.1689110742974 2023-07-11 21:25:42,992 DEBUG [Listener at localhost/46523] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35339,DS-54c3e1cf-d273-4ccd-94e0-dd3e620896d8,DISK], DatanodeInfoWithStorage[127.0.0.1:40531,DS-4da330b9-84ef-41cd-8ede-ce8b11252a86,DISK]] 2023-07-11 21:25:42,992 DEBUG [Listener at localhost/46523] wal.AbstractFSWAL(716): hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/WALs/test.com,8080,1/test.com%2C8080%2C1.1689110742956 is not closed yet, will try archiving it next time 2023-07-11 21:25:42,999 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/WALs/test.com,8080,1/test.com%2C8080%2C1.1689110742956 to hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/oldWALs/test.com%2C8080%2C1.1689110742956 2023-07-11 21:25:43,012 DEBUG [Listener at localhost/46523] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/oldWALs 2023-07-11 21:25:43,012 INFO [Listener at localhost/46523] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL test.com%2C8080%2C1:(num 1689110742974) 2023-07-11 21:25:43,012 INFO [Listener at localhost/46523] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 21:25:43,012 DEBUG [Listener at localhost/46523] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ee2c61f to 127.0.0.1:50879 2023-07-11 21:25:43,013 DEBUG [Listener at localhost/46523] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:25:43,014 DEBUG [Listener at localhost/46523] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 21:25:43,014 DEBUG [Listener at localhost/46523] util.JVMClusterUtil(257): Found active master hash=1162949993, stopped=false 2023-07-11 21:25:43,014 INFO [Listener at localhost/46523] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,40583,1689110741882 2023-07-11 21:25:43,018 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 21:25:43,018 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x101c1e34dc40001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 21:25:43,018 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:43,018 INFO [Listener at localhost/46523] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 21:25:43,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46217-0x101c1e34dc40001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:25:43,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 21:25:43,025 INFO [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1064): Closing user regions 2023-07-11 21:25:43,025 INFO [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(3305): Received CLOSE for 63a91e11c003da1ea7815624bdeff176 2023-07-11 21:25:43,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 63a91e11c003da1ea7815624bdeff176, disabling compactions & flushes 2023-07-11 21:25:43,029 DEBUG [Listener at localhost/46523] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bf6c55c to 127.0.0.1:50879 2023-07-11 21:25:43,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. 2023-07-11 21:25:43,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. 2023-07-11 21:25:43,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. after waiting 0 ms 2023-07-11 21:25:43,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. 2023-07-11 21:25:43,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 63a91e11c003da1ea7815624bdeff176 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 21:25:43,030 DEBUG [Listener at localhost/46523] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:25:43,030 INFO [Listener at localhost/46523] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,46217,1689110741923' ***** 2023-07-11 21:25:43,030 INFO [Listener at localhost/46523] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 21:25:43,031 INFO [RS:0;jenkins-hbase5:46217] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 21:25:43,031 INFO [RS:0;jenkins-hbase5:46217] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 21:25:43,031 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 21:25:43,031 INFO [RS:0;jenkins-hbase5:46217] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 21:25:43,031 INFO [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,46217,1689110741923 2023-07-11 21:25:43,031 DEBUG [RS:0;jenkins-hbase5:46217] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36ed04c7 to 127.0.0.1:50879 2023-07-11 21:25:43,031 DEBUG [RS:0;jenkins-hbase5:46217] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:25:43,031 INFO [RS:0;jenkins-hbase5:46217] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 21:25:43,031 INFO [RS:0;jenkins-hbase5:46217] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 21:25:43,031 INFO [RS:0;jenkins-hbase5:46217] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 21:25:43,031 INFO [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 21:25:43,040 INFO [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-11 21:25:43,041 DEBUG [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 63a91e11c003da1ea7815624bdeff176=hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176.} 2023-07-11 21:25:43,041 DEBUG [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1504): Waiting on 1588230740, 63a91e11c003da1ea7815624bdeff176 2023-07-11 21:25:43,041 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 21:25:43,041 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 21:25:43,041 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 21:25:43,041 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 21:25:43,041 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 21:25:43,041 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=1.26 KB heapSize=2.89 KB 2023-07-11 21:25:43,099 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.17 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/.tmp/info/4b79f9ce9fd34bc7b55c2cf971f79afb 2023-07-11 21:25:43,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176/.tmp/info/5b7b488d656843568f5fb7767cdae5b4 2023-07-11 21:25:43,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=94 B at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/.tmp/table/585a8984872f48a08c4df815f439c5ba 2023-07-11 21:25:43,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176/.tmp/info/5b7b488d656843568f5fb7767cdae5b4 as hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176/info/5b7b488d656843568f5fb7767cdae5b4 2023-07-11 21:25:43,150 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/.tmp/info/4b79f9ce9fd34bc7b55c2cf971f79afb as hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/info/4b79f9ce9fd34bc7b55c2cf971f79afb 2023-07-11 21:25:43,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176/info/5b7b488d656843568f5fb7767cdae5b4, entries=2, sequenceid=6, filesize=4.8 K 2023-07-11 21:25:43,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 63a91e11c003da1ea7815624bdeff176 in 123ms, sequenceid=6, compaction requested=false 2023-07-11 21:25:43,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 21:25:43,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/info/4b79f9ce9fd34bc7b55c2cf971f79afb, entries=10, sequenceid=9, filesize=5.9 K 2023-07-11 21:25:43,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/namespace/63a91e11c003da1ea7815624bdeff176/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 21:25:43,161 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/.tmp/table/585a8984872f48a08c4df815f439c5ba as hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/table/585a8984872f48a08c4df815f439c5ba 2023-07-11 21:25:43,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. 2023-07-11 21:25:43,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 63a91e11c003da1ea7815624bdeff176: 2023-07-11 21:25:43,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689110742479.63a91e11c003da1ea7815624bdeff176. 2023-07-11 21:25:43,167 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/table/585a8984872f48a08c4df815f439c5ba, entries=2, sequenceid=9, filesize=4.7 K 2023-07-11 21:25:43,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.26 KB/1290, heapSize ~2.61 KB/2672, currentSize=0 B/0 for 1588230740 in 127ms, sequenceid=9, compaction requested=false 2023-07-11 21:25:43,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 21:25:43,176 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 21:25:43,176 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 21:25:43,176 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/data/hbase/meta/1588230740/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-07-11 21:25:43,177 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 21:25:43,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 21:25:43,177 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 21:25:43,177 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 21:25:43,241 INFO [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,46217,1689110741923; all regions closed. 2023-07-11 21:25:43,246 DEBUG [RS:0;jenkins-hbase5:46217] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/oldWALs 2023-07-11 21:25:43,246 INFO [RS:0;jenkins-hbase5:46217] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C46217%2C1689110741923.meta:.meta(num 1689110742426) 2023-07-11 21:25:43,251 DEBUG [RS:0;jenkins-hbase5:46217] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/oldWALs 2023-07-11 21:25:43,251 INFO [RS:0;jenkins-hbase5:46217] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C46217%2C1689110741923:(num 1689110742300) 2023-07-11 21:25:43,251 DEBUG [RS:0;jenkins-hbase5:46217] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:25:43,251 INFO [RS:0;jenkins-hbase5:46217] regionserver.LeaseManager(133): Closed leases 2023-07-11 21:25:43,252 INFO [RS:0;jenkins-hbase5:46217] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 21:25:43,252 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 21:25:43,253 INFO [RS:0;jenkins-hbase5:46217] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:46217 2023-07-11 21:25:43,256 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x101c1e34dc40001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,46217,1689110741923 2023-07-11 21:25:43,256 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x101c1e34dc40001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:25:43,256 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 21:25:43,258 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,46217,1689110741923] 2023-07-11 21:25:43,258 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,46217,1689110741923; numProcessing=1 2023-07-11 21:25:43,260 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,46217,1689110741923 already deleted, retry=false 2023-07-11 21:25:43,260 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,46217,1689110741923 expired; onlineServers=0 2023-07-11 21:25:43,260 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,40583,1689110741882' ***** 2023-07-11 21:25:43,260 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 21:25:43,260 DEBUG [M:0;jenkins-hbase5:40583] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@416eb91b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-11 21:25:43,260 INFO [M:0;jenkins-hbase5:40583] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,40583,1689110741882 2023-07-11 21:25:43,260 INFO [M:0;jenkins-hbase5:40583] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,40583,1689110741882; all regions closed. 2023-07-11 21:25:43,260 DEBUG [M:0;jenkins-hbase5:40583] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 21:25:43,260 DEBUG [M:0;jenkins-hbase5:40583] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 21:25:43,261 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 21:25:43,261 DEBUG [M:0;jenkins-hbase5:40583] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 21:25:43,261 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689110742073] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689110742073,5,FailOnTimeoutGroup] 2023-07-11 21:25:43,261 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689110742073] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689110742073,5,FailOnTimeoutGroup] 2023-07-11 21:25:43,261 INFO [M:0;jenkins-hbase5:40583] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 21:25:43,262 INFO [M:0;jenkins-hbase5:40583] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 21:25:43,262 INFO [M:0;jenkins-hbase5:40583] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-07-11 21:25:43,262 DEBUG [M:0;jenkins-hbase5:40583] master.HMaster(1512): Stopping service threads 2023-07-11 21:25:43,262 INFO [M:0;jenkins-hbase5:40583] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 21:25:43,262 ERROR [M:0;jenkins-hbase5:40583] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-7,5,PEWorkerGroup] 2023-07-11 21:25:43,263 INFO [M:0;jenkins-hbase5:40583] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 21:25:43,263 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 21:25:43,263 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 21:25:43,263 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 21:25:43,263 DEBUG [M:0;jenkins-hbase5:40583] zookeeper.ZKUtil(398): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 21:25:43,263 WARN [M:0;jenkins-hbase5:40583] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 21:25:43,263 INFO [M:0;jenkins-hbase5:40583] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 21:25:43,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 21:25:43,264 INFO [M:0;jenkins-hbase5:40583] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 21:25:43,264 DEBUG [M:0;jenkins-hbase5:40583] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 21:25:43,264 INFO [M:0;jenkins-hbase5:40583] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:25:43,264 DEBUG [M:0;jenkins-hbase5:40583] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:25:43,264 DEBUG [M:0;jenkins-hbase5:40583] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 21:25:43,264 DEBUG [M:0;jenkins-hbase5:40583] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:25:43,264 INFO [M:0;jenkins-hbase5:40583] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=24.07 KB heapSize=29.55 KB 2023-07-11 21:25:43,276 INFO [M:0;jenkins-hbase5:40583] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24.07 KB at sequenceid=66 (bloomFilter=true), to=hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1594c5c75fe248018bff07543c7f6ac1 2023-07-11 21:25:43,282 DEBUG [M:0;jenkins-hbase5:40583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1594c5c75fe248018bff07543c7f6ac1 as hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1594c5c75fe248018bff07543c7f6ac1 2023-07-11 21:25:43,288 INFO [M:0;jenkins-hbase5:40583] regionserver.HStore(1080): Added hdfs://localhost:42949/user/jenkins/test-data/fb05ef48-8f78-cc5b-4651-7b9257ea8a1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1594c5c75fe248018bff07543c7f6ac1, entries=8, sequenceid=66, filesize=6.3 K 2023-07-11 21:25:43,289 INFO [M:0;jenkins-hbase5:40583] regionserver.HRegion(2948): Finished flush of dataSize ~24.07 KB/24646, heapSize ~29.54 KB/30248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=66, compaction requested=false 2023-07-11 21:25:43,292 INFO [M:0;jenkins-hbase5:40583] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 21:25:43,292 DEBUG [M:0;jenkins-hbase5:40583] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 21:25:43,298 INFO [M:0;jenkins-hbase5:40583] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 21:25:43,298 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 21:25:43,299 INFO [M:0;jenkins-hbase5:40583] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:40583 2023-07-11 21:25:43,302 DEBUG [M:0;jenkins-hbase5:40583] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,40583,1689110741882 already deleted, retry=false 2023-07-11 21:25:43,358 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x101c1e34dc40001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:25:43,358 INFO [RS:0;jenkins-hbase5:46217] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,46217,1689110741923; zookeeper connection closed. 2023-07-11 21:25:43,358 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x101c1e34dc40001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:25:43,358 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@39da27e0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@39da27e0 2023-07-11 21:25:43,359 INFO [Listener at localhost/46523] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-11 21:25:43,458 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:25:43,458 INFO [M:0;jenkins-hbase5:40583] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,40583,1689110741882; zookeeper connection closed. 2023-07-11 21:25:43,458 DEBUG [Listener at localhost/46523-EventThread] zookeeper.ZKWatcher(600): master:40583-0x101c1e34dc40000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 21:25:43,461 WARN [Listener at localhost/46523] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:25:43,471 INFO [Listener at localhost/46523] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:25:43,575 WARN [BP-1586707892-172.31.10.131-1689110741207 heartbeating to localhost/127.0.0.1:42949] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:25:43,576 WARN [BP-1586707892-172.31.10.131-1689110741207 heartbeating to localhost/127.0.0.1:42949] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1586707892-172.31.10.131-1689110741207 (Datanode Uuid 2491b02c-f239-4fea-90a3-ac2d809318ab) service to localhost/127.0.0.1:42949 2023-07-11 21:25:43,576 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/cluster_ac787357-0e5f-de7c-9d68-8ad1874d8168/dfs/data/data3/current/BP-1586707892-172.31.10.131-1689110741207] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:25:43,577 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/cluster_ac787357-0e5f-de7c-9d68-8ad1874d8168/dfs/data/data4/current/BP-1586707892-172.31.10.131-1689110741207] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:25:43,578 WARN [Listener at localhost/46523] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 21:25:43,582 INFO [Listener at localhost/46523] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:25:43,685 WARN [BP-1586707892-172.31.10.131-1689110741207 heartbeating to localhost/127.0.0.1:42949] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 21:25:43,686 WARN [BP-1586707892-172.31.10.131-1689110741207 heartbeating to localhost/127.0.0.1:42949] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1586707892-172.31.10.131-1689110741207 (Datanode Uuid 93cd066d-ea70-405b-b658-74fe84a6b613) service to localhost/127.0.0.1:42949 2023-07-11 21:25:43,686 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/cluster_ac787357-0e5f-de7c-9d68-8ad1874d8168/dfs/data/data1/current/BP-1586707892-172.31.10.131-1689110741207] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:25:43,687 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/39e9bc1a-75a3-f604-2be9-f7dd9cf3efa5/cluster_ac787357-0e5f-de7c-9d68-8ad1874d8168/dfs/data/data2/current/BP-1586707892-172.31.10.131-1689110741207] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 21:25:43,701 INFO [Listener at localhost/46523] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 21:25:43,814 INFO [Listener at localhost/46523] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 21:25:43,830 INFO [Listener at localhost/46523] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-11 21:25:43,843 INFO [Listener at localhost/46523] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=100 (was 77) - Thread LEAK? -, OpenFileDescriptor=488 (was 460) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=465 (was 465), ProcessCount=169 (was 169), AvailableMemoryMB=2549 (was 2532) - AvailableMemoryMB LEAK? -