2023-07-28 20:53:39,916 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e 2023-07-28 20:53:39,938 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling timeout: 13 mins 2023-07-28 20:53:39,995 INFO [Time-limited test] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=1470, ProcessCount=194, AvailableMemoryMB=314 2023-07-28 20:53:40,005 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-28 20:53:40,006 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca, deleteOnExit=true 2023-07-28 20:53:40,007 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-28 20:53:40,008 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/test.cache.data in system properties and HBase conf 2023-07-28 20:53:40,009 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/hadoop.tmp.dir in system properties and HBase conf 2023-07-28 20:53:40,009 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/hadoop.log.dir in system properties and HBase conf 2023-07-28 20:53:40,010 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-28 20:53:40,011 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-28 20:53:40,011 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-28 20:53:40,183 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-28 20:53:40,793 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-28 20:53:40,801 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-28 20:53:40,802 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-28 20:53:40,803 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-28 20:53:40,804 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-28 20:53:40,804 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-28 20:53:40,805 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-28 20:53:40,805 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-28 20:53:40,809 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-28 20:53:40,811 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-28 20:53:40,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/nfs.dump.dir in system properties and HBase conf 2023-07-28 20:53:40,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/java.io.tmpdir in system properties and HBase conf 2023-07-28 20:53:40,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-28 20:53:40,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-28 20:53:40,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-28 20:53:41,811 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-28 20:53:41,818 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-28 20:53:42,552 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-28 20:53:42,834 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-28 20:53:42,861 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:53:42,932 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:53:42,995 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/java.io.tmpdir/Jetty_localhost_localdomain_45897_hdfs____6rx0cv/webapp 2023-07-28 20:53:43,271 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:45897 2023-07-28 20:53:43,283 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-28 20:53:43,283 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-28 20:53:44,046 WARN [Listener at localhost.localdomain/44723] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:53:44,498 WARN [Listener at localhost.localdomain/44723] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-28 20:53:44,552 WARN [Listener at localhost.localdomain/44723] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:53:44,562 INFO [Listener at localhost.localdomain/44723] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:53:44,577 INFO [Listener at localhost.localdomain/44723] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/java.io.tmpdir/Jetty_localhost_45429_datanode____a9b2o1/webapp 2023-07-28 20:53:44,724 INFO [Listener at localhost.localdomain/44723] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45429 2023-07-28 20:53:45,419 WARN [Listener at localhost.localdomain/38291] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:53:45,610 WARN [Listener at localhost.localdomain/38291] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-28 20:53:45,628 WARN [Listener at localhost.localdomain/38291] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:53:45,632 INFO [Listener at localhost.localdomain/38291] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:53:45,672 INFO [Listener at localhost.localdomain/38291] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/java.io.tmpdir/Jetty_localhost_36137_datanode____.mzkavb/webapp 2023-07-28 20:53:45,896 INFO [Listener at localhost.localdomain/38291] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36137 2023-07-28 20:53:45,956 WARN [Listener at localhost.localdomain/37723] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:53:46,936 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x54028e3d527e73e: Processing first storage report for DS-4006dc1c-a56d-4623-a501-af6cf7338d37 from datanode 81d55b81-884d-4631-a519-1a4456408b4a 2023-07-28 20:53:46,955 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x54028e3d527e73e: from storage DS-4006dc1c-a56d-4623-a501-af6cf7338d37 node DatanodeRegistration(127.0.0.1:41633, datanodeUuid=81d55b81-884d-4631-a519-1a4456408b4a, infoPort=41625, infoSecurePort=0, ipcPort=37723, storageInfo=lv=-57;cid=testClusterID;nsid=1263892384;c=1690577621927), blocks: 0, hasStaleStorage: true, processing time: 19 msecs, invalidatedBlocks: 0 2023-07-28 20:53:46,960 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2fe864fc33ac5a9c: Processing first storage report for DS-ac39038b-f25c-487c-8d25-0b27ddf46695 from datanode ab2b275a-74ca-41ed-8b9b-522f16edc94c 2023-07-28 20:53:46,960 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2fe864fc33ac5a9c: from storage DS-ac39038b-f25c-487c-8d25-0b27ddf46695 node DatanodeRegistration(127.0.0.1:46219, datanodeUuid=ab2b275a-74ca-41ed-8b9b-522f16edc94c, infoPort=44365, infoSecurePort=0, ipcPort=38291, storageInfo=lv=-57;cid=testClusterID;nsid=1263892384;c=1690577621927), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-28 20:53:46,960 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x54028e3d527e73e: Processing first storage report for DS-7c6b6893-3ad4-4f84-9f6a-028933ff3fff from datanode 81d55b81-884d-4631-a519-1a4456408b4a 2023-07-28 20:53:46,961 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x54028e3d527e73e: from storage DS-7c6b6893-3ad4-4f84-9f6a-028933ff3fff node DatanodeRegistration(127.0.0.1:41633, datanodeUuid=81d55b81-884d-4631-a519-1a4456408b4a, infoPort=41625, infoSecurePort=0, ipcPort=37723, storageInfo=lv=-57;cid=testClusterID;nsid=1263892384;c=1690577621927), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:53:46,961 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2fe864fc33ac5a9c: Processing first storage report for DS-a4175d4b-92bd-45a0-9c7b-502b69291ed2 from datanode ab2b275a-74ca-41ed-8b9b-522f16edc94c 2023-07-28 20:53:46,961 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2fe864fc33ac5a9c: from storage DS-a4175d4b-92bd-45a0-9c7b-502b69291ed2 node DatanodeRegistration(127.0.0.1:46219, datanodeUuid=ab2b275a-74ca-41ed-8b9b-522f16edc94c, infoPort=44365, infoSecurePort=0, ipcPort=38291, storageInfo=lv=-57;cid=testClusterID;nsid=1263892384;c=1690577621927), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:53:47,140 DEBUG [Listener at localhost.localdomain/37723] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e 2023-07-28 20:53:47,293 INFO [Listener at localhost.localdomain/37723] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/zookeeper_0, clientPort=63165, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-28 20:53:47,332 INFO [Listener at localhost.localdomain/37723] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63165 2023-07-28 20:53:47,348 INFO [Listener at localhost.localdomain/37723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:53:47,363 INFO [Listener at localhost.localdomain/37723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:53:47,951 INFO [Listener at localhost.localdomain/37723] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3 with version=8 2023-07-28 20:53:47,952 INFO [Listener at localhost.localdomain/37723] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/hbase-staging 2023-07-28 20:53:48,379 INFO [Listener at localhost.localdomain/37723] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-28 20:53:49,367 INFO [Listener at localhost.localdomain/37723] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-28 20:53:49,409 INFO [Listener at localhost.localdomain/37723] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:53:49,410 INFO [Listener at localhost.localdomain/37723] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-28 20:53:49,410 INFO [Listener at localhost.localdomain/37723] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-28 20:53:49,411 INFO [Listener at localhost.localdomain/37723] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:53:49,411 INFO [Listener at localhost.localdomain/37723] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-28 20:53:49,751 INFO [Listener at localhost.localdomain/37723] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-28 20:53:49,932 DEBUG [Listener at localhost.localdomain/37723] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-28 20:53:50,104 INFO [Listener at localhost.localdomain/37723] ipc.NettyRpcServer(120): Bind to /136.243.18.41:37137 2023-07-28 20:53:50,152 INFO [Listener at localhost.localdomain/37723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:53:50,155 INFO [Listener at localhost.localdomain/37723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:53:50,201 INFO [Listener at localhost.localdomain/37723] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37137 connecting to ZooKeeper ensemble=127.0.0.1:63165 2023-07-28 20:53:50,309 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:371370x0, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-28 20:53:50,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37137-0x101adb4e3910000 connected 2023-07-28 20:53:50,487 DEBUG [Listener at localhost.localdomain/37723] zookeeper.ZKUtil(164): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-28 20:53:50,488 DEBUG [Listener at localhost.localdomain/37723] zookeeper.ZKUtil(164): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:53:50,495 DEBUG [Listener at localhost.localdomain/37723] zookeeper.ZKUtil(164): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-28 20:53:50,510 DEBUG [Listener at localhost.localdomain/37723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37137 2023-07-28 20:53:50,510 DEBUG [Listener at localhost.localdomain/37723] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37137 2023-07-28 20:53:50,512 DEBUG [Listener at localhost.localdomain/37723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37137 2023-07-28 20:53:50,526 DEBUG [Listener at localhost.localdomain/37723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37137 2023-07-28 20:53:50,536 DEBUG [Listener at localhost.localdomain/37723] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37137 2023-07-28 20:53:50,546 INFO [Listener at localhost.localdomain/37723] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3, hbase.cluster.distributed=false 2023-07-28 20:53:50,762 INFO [Listener at localhost.localdomain/37723] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-28 20:53:50,762 INFO [Listener at localhost.localdomain/37723] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:53:50,762 INFO [Listener at localhost.localdomain/37723] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-28 20:53:50,762 INFO [Listener at localhost.localdomain/37723] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-28 20:53:50,762 INFO [Listener at localhost.localdomain/37723] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:53:50,763 INFO [Listener at localhost.localdomain/37723] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-28 20:53:50,768 INFO [Listener at localhost.localdomain/37723] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-28 20:53:50,781 INFO [Listener at localhost.localdomain/37723] ipc.NettyRpcServer(120): Bind to /136.243.18.41:41029 2023-07-28 20:53:50,784 INFO [Listener at localhost.localdomain/37723] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-28 20:53:50,837 DEBUG [Listener at localhost.localdomain/37723] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-28 20:53:50,839 INFO [Listener at localhost.localdomain/37723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:53:50,844 INFO [Listener at localhost.localdomain/37723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:53:50,853 INFO [Listener at localhost.localdomain/37723] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41029 connecting to ZooKeeper ensemble=127.0.0.1:63165 2023-07-28 20:53:50,904 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): regionserver:410290x0, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-28 20:53:50,909 DEBUG [Listener at localhost.localdomain/37723] zookeeper.ZKUtil(164): regionserver:410290x0, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-28 20:53:50,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41029-0x101adb4e3910001 connected 2023-07-28 20:53:50,936 DEBUG [Listener at localhost.localdomain/37723] zookeeper.ZKUtil(164): regionserver:41029-0x101adb4e3910001, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:53:50,941 DEBUG [Listener at localhost.localdomain/37723] zookeeper.ZKUtil(164): regionserver:41029-0x101adb4e3910001, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-28 20:53:50,946 DEBUG [Listener at localhost.localdomain/37723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41029 2023-07-28 20:53:50,960 DEBUG [Listener at localhost.localdomain/37723] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41029 2023-07-28 20:53:50,980 DEBUG [Listener at localhost.localdomain/37723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41029 2023-07-28 20:53:50,987 DEBUG [Listener at localhost.localdomain/37723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41029 2023-07-28 20:53:50,987 DEBUG [Listener at localhost.localdomain/37723] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41029 2023-07-28 20:53:51,009 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,37137,1690577628154 2023-07-28 20:53:51,055 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-28 20:53:51,068 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,37137,1690577628154 2023-07-28 20:53:51,109 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-28 20:53:51,109 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:53:51,110 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-28 20:53:51,112 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x101adb4e3910001, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-28 20:53:51,118 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,37137,1690577628154 from backup master directory 2023-07-28 20:53:51,137 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,37137,1690577628154 2023-07-28 20:53:51,137 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-28 20:53:51,139 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-28 20:53:51,139 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,37137,1690577628154 2023-07-28 20:53:51,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-28 20:53:51,143 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-28 20:53:51,149 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-28 20:53:51,934 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/hbase.id with ID: f50bd803-2555-4331-8bc3-ee0ebe0b4a3a 2023-07-28 20:53:52,089 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:53:52,128 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:53:52,761 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1e3d32d9 to 127.0.0.1:63165 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-28 20:53:52,912 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17629ecb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-28 20:53:52,983 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-28 20:53:52,993 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-28 20:53:53,033 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:53:53,139 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/data/master/store-tmp 2023-07-28 20:53:53,356 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:53:53,356 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-28 20:53:53,357 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:53:53,357 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:53:53,357 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-28 20:53:53,357 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:53:53,357 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:53:53,357 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-28 20:53:53,362 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/WALs/jenkins-hbase17.apache.org,37137,1690577628154 2023-07-28 20:53:53,475 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C37137%2C1690577628154, suffix=, logDir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/WALs/jenkins-hbase17.apache.org,37137,1690577628154, archiveDir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/oldWALs, maxLogs=10 2023-07-28 20:53:53,593 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-28 20:53:53,594 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-28 20:53:53,600 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:53) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:190) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:719) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:128) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:881) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:574) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:515) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:160) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:295) at org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:200) at org.apache.hadoop.hbase.master.region.MasterRegion.bootstrap(MasterRegion.java:220) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:348) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:53:53,721 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:417) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:53:53,724 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41633,DS-4006dc1c-a56d-4623-a501-af6cf7338d37,DISK] 2023-07-28 20:53:53,729 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46219,DS-ac39038b-f25c-487c-8d25-0b27ddf46695,DISK] 2023-07-28 20:53:53,744 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:53:53,964 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/WALs/jenkins-hbase17.apache.org,37137,1690577628154/jenkins-hbase17.apache.org%2C37137%2C1690577628154.1690577633532 2023-07-28 20:53:53,975 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46219,DS-ac39038b-f25c-487c-8d25-0b27ddf46695,DISK], DatanodeInfoWithStorage[127.0.0.1:41633,DS-4006dc1c-a56d-4623-a501-af6cf7338d37,DISK]] 2023-07-28 20:53:53,976 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:53:53,977 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:53:53,983 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:53:53,985 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:53:54,183 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:53:54,196 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-28 20:53:54,250 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-28 20:53:54,277 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:53:54,290 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:53:54,295 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:53:54,358 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:53:54,388 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:53:54,392 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=798597, jitterRate=0.015469536185264587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:53:54,392 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-28 20:53:54,394 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-28 20:53:54,438 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-28 20:53:54,438 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-28 20:53:54,452 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-28 20:53:54,454 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-28 20:53:54,510 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 55 msec 2023-07-28 20:53:54,511 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-28 20:53:54,570 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-28 20:53:54,583 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-28 20:53:54,670 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-28 20:53:54,675 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-28 20:53:54,680 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-28 20:53:54,689 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-28 20:53:54,696 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-28 20:53:54,724 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:53:54,737 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-28 20:53:54,741 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-28 20:53:54,791 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-28 20:53:54,807 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-28 20:53:54,807 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:53:54,808 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x101adb4e3910001, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-28 20:53:54,815 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,37137,1690577628154, sessionid=0x101adb4e3910000, setting cluster-up flag (Was=false) 2023-07-28 20:53:54,865 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:53:54,904 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-28 20:53:54,917 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,37137,1690577628154 2023-07-28 20:53:54,952 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:53:55,004 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-28 20:53:55,029 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,37137,1690577628154 2023-07-28 20:53:55,036 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/.hbase-snapshot/.tmp 2023-07-28 20:53:55,079 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(951): ClusterId : f50bd803-2555-4331-8bc3-ee0ebe0b4a3a 2023-07-28 20:53:55,089 DEBUG [RS:0;jenkins-hbase17:41029] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-28 20:53:55,117 DEBUG [RS:0;jenkins-hbase17:41029] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-28 20:53:55,117 DEBUG [RS:0;jenkins-hbase17:41029] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-28 20:53:55,177 DEBUG [RS:0;jenkins-hbase17:41029] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-28 20:53:55,188 DEBUG [RS:0;jenkins-hbase17:41029] zookeeper.ReadOnlyZKClient(139): Connect 0x24af4ab7 to 127.0.0.1:63165 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-28 20:53:55,241 DEBUG [RS:0;jenkins-hbase17:41029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a68a052, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-28 20:53:55,245 DEBUG [RS:0;jenkins-hbase17:41029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e5721c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-28 20:53:55,318 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:41029 2023-07-28 20:53:55,325 INFO [RS:0;jenkins-hbase17:41029] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-28 20:53:55,325 INFO [RS:0;jenkins-hbase17:41029] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-28 20:53:55,325 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1022): About to register with Master. 2023-07-28 20:53:55,333 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,37137,1690577628154 with isa=jenkins-hbase17.apache.org/136.243.18.41:41029, startcode=1690577630761 2023-07-28 20:53:55,372 DEBUG [RS:0;jenkins-hbase17:41029] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-28 20:53:55,525 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-28 20:53:55,529 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59053, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-28 20:53:55,545 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37137] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-28 20:53:55,555 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:53:55,555 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:53:55,555 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:53:55,556 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:53:55,556 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-28 20:53:55,556 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:53:55,556 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-28 20:53:55,556 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:53:55,639 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690577665639 2023-07-28 20:53:55,641 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-28 20:53:55,705 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-28 20:53:55,705 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(2830): Master is not running yet 2023-07-28 20:53:55,713 WARN [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-28 20:53:55,705 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-28 20:53:55,706 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-28 20:53:55,727 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-28 20:53:55,727 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-28 20:53:55,729 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-28 20:53:55,730 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-28 20:53:55,739 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-28 20:53:55,741 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:55,746 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-28 20:53:55,761 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-28 20:53:55,762 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-28 20:53:55,780 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-28 20:53:55,781 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-28 20:53:55,790 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690577635790,5,FailOnTimeoutGroup] 2023-07-28 20:53:55,793 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690577635791,5,FailOnTimeoutGroup] 2023-07-28 20:53:55,793 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:55,794 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-28 20:53:55,795 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:55,795 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:55,814 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,37137,1690577628154 with isa=jenkins-hbase17.apache.org/136.243.18.41:41029, startcode=1690577630761 2023-07-28 20:53:55,865 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37137] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:53:55,913 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3 2023-07-28 20:53:55,913 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:44723 2023-07-28 20:53:55,913 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-28 20:53:55,937 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-28 20:53:55,949 DEBUG [RS:0;jenkins-hbase17:41029] zookeeper.ZKUtil(162): regionserver:41029-0x101adb4e3910001, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:53:55,949 WARN [RS:0;jenkins-hbase17:41029] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-28 20:53:55,969 INFO [RS:0;jenkins-hbase17:41029] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:53:55,976 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:53:55,977 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,41029,1690577630761] 2023-07-28 20:53:56,098 DEBUG [RS:0;jenkins-hbase17:41029] zookeeper.ZKUtil(162): regionserver:41029-0x101adb4e3910001, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:53:56,129 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-28 20:53:56,141 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-28 20:53:56,142 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-28 20:53:56,141 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3 2023-07-28 20:53:56,190 INFO [RS:0;jenkins-hbase17:41029] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-28 20:53:56,355 INFO [RS:0;jenkins-hbase17:41029] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-28 20:53:56,392 INFO [RS:0;jenkins-hbase17:41029] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-28 20:53:56,392 INFO [RS:0;jenkins-hbase17:41029] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:56,398 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-28 20:53:56,398 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:53:56,424 INFO [RS:0;jenkins-hbase17:41029] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:56,425 DEBUG [RS:0;jenkins-hbase17:41029] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:53:56,461 DEBUG [RS:0;jenkins-hbase17:41029] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:53:56,461 DEBUG [RS:0;jenkins-hbase17:41029] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:53:56,461 DEBUG [RS:0;jenkins-hbase17:41029] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:53:56,461 DEBUG [RS:0;jenkins-hbase17:41029] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:53:56,462 DEBUG [RS:0;jenkins-hbase17:41029] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-28 20:53:56,462 DEBUG [RS:0;jenkins-hbase17:41029] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:53:56,462 DEBUG [RS:0;jenkins-hbase17:41029] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:53:56,462 DEBUG [RS:0;jenkins-hbase17:41029] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:53:56,462 DEBUG [RS:0;jenkins-hbase17:41029] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:53:56,492 INFO [RS:0;jenkins-hbase17:41029] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:56,492 INFO [RS:0;jenkins-hbase17:41029] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:56,493 INFO [RS:0;jenkins-hbase17:41029] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:56,477 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-28 20:53:56,510 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/info 2023-07-28 20:53:56,511 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-28 20:53:56,526 INFO [RS:0;jenkins-hbase17:41029] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-28 20:53:56,528 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:53:56,533 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-28 20:53:56,533 INFO [RS:0;jenkins-hbase17:41029] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,41029,1690577630761-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:56,581 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/rep_barrier 2023-07-28 20:53:56,582 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-28 20:53:56,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:53:56,586 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-28 20:53:56,592 INFO [RS:0;jenkins-hbase17:41029] regionserver.Replication(203): jenkins-hbase17.apache.org,41029,1690577630761 started 2023-07-28 20:53:56,605 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,41029,1690577630761, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:41029, sessionid=0x101adb4e3910001 2023-07-28 20:53:56,605 DEBUG [RS:0;jenkins-hbase17:41029] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-28 20:53:56,605 DEBUG [RS:0;jenkins-hbase17:41029] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:53:56,606 DEBUG [RS:0;jenkins-hbase17:41029] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,41029,1690577630761' 2023-07-28 20:53:56,606 DEBUG [RS:0;jenkins-hbase17:41029] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:53:56,612 DEBUG [RS:0;jenkins-hbase17:41029] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:53:56,616 DEBUG [RS:0;jenkins-hbase17:41029] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-28 20:53:56,617 DEBUG [RS:0;jenkins-hbase17:41029] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-28 20:53:56,617 DEBUG [RS:0;jenkins-hbase17:41029] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:53:56,617 DEBUG [RS:0;jenkins-hbase17:41029] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,41029,1690577630761' 2023-07-28 20:53:56,617 DEBUG [RS:0;jenkins-hbase17:41029] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-28 20:53:56,625 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/table 2023-07-28 20:53:56,626 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-28 20:53:56,629 DEBUG [RS:0;jenkins-hbase17:41029] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-28 20:53:56,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:53:56,637 DEBUG [RS:0;jenkins-hbase17:41029] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-28 20:53:56,637 INFO [RS:0;jenkins-hbase17:41029] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-28 20:53:56,637 INFO [RS:0;jenkins-hbase17:41029] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-28 20:53:56,644 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740 2023-07-28 20:53:56,648 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740 2023-07-28 20:53:56,686 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-28 20:53:56,695 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-28 20:53:56,732 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:53:56,744 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=720964, jitterRate=-0.08324752748012543}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-28 20:53:56,744 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-28 20:53:56,744 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-28 20:53:56,744 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-28 20:53:56,744 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-28 20:53:56,744 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-28 20:53:56,744 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-28 20:53:56,760 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-28 20:53:56,760 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-28 20:53:56,763 INFO [RS:0;jenkins-hbase17:41029] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C41029%2C1690577630761, suffix=, logDir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761, archiveDir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/oldWALs, maxLogs=32 2023-07-28 20:53:56,813 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-28 20:53:56,813 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-28 20:53:56,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-28 20:53:56,944 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41633,DS-4006dc1c-a56d-4623-a501-af6cf7338d37,DISK] 2023-07-28 20:53:56,956 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46219,DS-ac39038b-f25c-487c-8d25-0b27ddf46695,DISK] 2023-07-28 20:53:56,970 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-28 20:53:57,006 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-28 20:53:57,033 INFO [RS:0;jenkins-hbase17:41029] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.1690577636805 2023-07-28 20:53:57,040 DEBUG [RS:0;jenkins-hbase17:41029] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41633,DS-4006dc1c-a56d-4623-a501-af6cf7338d37,DISK], DatanodeInfoWithStorage[127.0.0.1:46219,DS-ac39038b-f25c-487c-8d25-0b27ddf46695,DISK]] 2023-07-28 20:53:57,178 DEBUG [jenkins-hbase17:37137] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-28 20:53:57,185 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,41029,1690577630761, state=OPENING 2023-07-28 20:53:57,220 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-28 20:53:57,222 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:53:57,223 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-28 20:53:57,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,41029,1690577630761}] 2023-07-28 20:53:57,494 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:53:57,502 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-28 20:53:57,513 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-28 20:53:57,547 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-28 20:53:57,548 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:53:57,578 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761, archiveDir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/oldWALs, maxLogs=32 2023-07-28 20:53:57,625 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41633,DS-4006dc1c-a56d-4623-a501-af6cf7338d37,DISK] 2023-07-28 20:53:57,639 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46219,DS-ac39038b-f25c-487c-8d25-0b27ddf46695,DISK] 2023-07-28 20:53:57,668 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta.1690577637581.meta 2023-07-28 20:53:57,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41633,DS-4006dc1c-a56d-4623-a501-af6cf7338d37,DISK], DatanodeInfoWithStorage[127.0.0.1:46219,DS-ac39038b-f25c-487c-8d25-0b27ddf46695,DISK]] 2023-07-28 20:53:57,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:53:57,675 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-28 20:53:57,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-28 20:53:57,722 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-28 20:53:57,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-28 20:53:57,731 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:53:57,731 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-28 20:53:57,731 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-28 20:53:57,748 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-28 20:53:57,760 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/info 2023-07-28 20:53:57,760 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/info 2023-07-28 20:53:57,761 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-28 20:53:57,768 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:53:57,768 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-28 20:53:57,792 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/rep_barrier 2023-07-28 20:53:57,792 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/rep_barrier 2023-07-28 20:53:57,793 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-28 20:53:57,800 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:53:57,801 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-28 20:53:57,816 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/table 2023-07-28 20:53:57,816 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/table 2023-07-28 20:53:57,817 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-28 20:53:57,828 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:53:57,840 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740 2023-07-28 20:53:57,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740 2023-07-28 20:53:57,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-28 20:53:57,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-28 20:53:57,921 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=754344, jitterRate=-0.04080238938331604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-28 20:53:57,922 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-28 20:53:57,943 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690577637472 2023-07-28 20:53:57,998 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-28 20:53:58,000 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-28 20:53:58,005 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,41029,1690577630761, state=OPEN 2023-07-28 20:53:58,020 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-28 20:53:58,020 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-28 20:53:58,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-28 20:53:58,036 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,41029,1690577630761 in 786 msec 2023-07-28 20:53:58,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-28 20:53:58,049 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.2010 sec 2023-07-28 20:53:58,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 2.8860 sec 2023-07-28 20:53:58,065 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690577638065, completionTime=-1 2023-07-28 20:53:58,065 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-28 20:53:58,067 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-28 20:53:58,202 DEBUG [hconnection-0x3733a853-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-28 20:53:58,217 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-28 20:53:58,265 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-28 20:53:58,265 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690577698265 2023-07-28 20:53:58,265 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690577758265 2023-07-28 20:53:58,265 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 198 msec 2023-07-28 20:53:58,333 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,37137,1690577628154-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:58,334 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,37137,1690577628154-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:58,334 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,37137,1690577628154-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:58,336 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:37137, period=300000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:58,343 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-28 20:53:58,348 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-28 20:53:58,369 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-28 20:53:58,370 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-28 20:53:58,371 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-28 20:53:58,373 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-28 20:53:58,404 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-28 20:53:58,411 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-28 20:53:58,417 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-28 20:53:58,464 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/.tmp/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:53:58,468 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/.tmp/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a empty. 2023-07-28 20:53:58,470 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/.tmp/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:53:58,470 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-28 20:53:58,651 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-28 20:53:58,665 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => bf5869d7e4614f83b0a59568590bcd9a, NAME => 'hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/.tmp 2023-07-28 20:53:58,824 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:53:58,825 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing bf5869d7e4614f83b0a59568590bcd9a, disabling compactions & flushes 2023-07-28 20:53:58,825 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. 2023-07-28 20:53:58,825 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. 2023-07-28 20:53:58,825 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. after waiting 0 ms 2023-07-28 20:53:58,825 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. 2023-07-28 20:53:58,825 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. 2023-07-28 20:53:58,825 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for bf5869d7e4614f83b0a59568590bcd9a: 2023-07-28 20:53:58,847 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-28 20:53:58,905 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690577638885"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690577638885"}]},"ts":"1690577638885"} 2023-07-28 20:53:58,985 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-28 20:53:58,995 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-28 20:53:59,001 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577638995"}]},"ts":"1690577638995"} 2023-07-28 20:53:59,020 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-28 20:53:59,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bf5869d7e4614f83b0a59568590bcd9a, ASSIGN}] 2023-07-28 20:53:59,098 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bf5869d7e4614f83b0a59568590bcd9a, ASSIGN 2023-07-28 20:53:59,109 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=bf5869d7e4614f83b0a59568590bcd9a, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41029,1690577630761; forceNewPlan=false, retain=false 2023-07-28 20:53:59,267 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bf5869d7e4614f83b0a59568590bcd9a, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:53:59,268 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690577639267"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690577639267"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690577639267"}]},"ts":"1690577639267"} 2023-07-28 20:53:59,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure bf5869d7e4614f83b0a59568590bcd9a, server=jenkins-hbase17.apache.org,41029,1690577630761}] 2023-07-28 20:53:59,497 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. 2023-07-28 20:53:59,498 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bf5869d7e4614f83b0a59568590bcd9a, NAME => 'hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a.', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:53:59,499 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:53:59,499 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:53:59,499 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:53:59,500 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:53:59,515 INFO [StoreOpener-bf5869d7e4614f83b0a59568590bcd9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:53:59,528 DEBUG [StoreOpener-bf5869d7e4614f83b0a59568590bcd9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a/info 2023-07-28 20:53:59,528 DEBUG [StoreOpener-bf5869d7e4614f83b0a59568590bcd9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a/info 2023-07-28 20:53:59,529 INFO [StoreOpener-bf5869d7e4614f83b0a59568590bcd9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf5869d7e4614f83b0a59568590bcd9a columnFamilyName info 2023-07-28 20:53:59,533 INFO [StoreOpener-bf5869d7e4614f83b0a59568590bcd9a-1] regionserver.HStore(310): Store=bf5869d7e4614f83b0a59568590bcd9a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:53:59,541 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:53:59,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:53:59,576 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:53:59,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:53:59,607 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened bf5869d7e4614f83b0a59568590bcd9a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=841688, jitterRate=0.07026182115077972}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:53:59,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for bf5869d7e4614f83b0a59568590bcd9a: 2023-07-28 20:53:59,617 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a., pid=6, masterSystemTime=1690577639442 2023-07-28 20:53:59,640 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. 2023-07-28 20:53:59,640 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. 2023-07-28 20:53:59,642 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bf5869d7e4614f83b0a59568590bcd9a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:53:59,645 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690577639641"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690577639641"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690577639641"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690577639641"}]},"ts":"1690577639641"} 2023-07-28 20:53:59,691 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-28 20:53:59,691 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure bf5869d7e4614f83b0a59568590bcd9a, server=jenkins-hbase17.apache.org,41029,1690577630761 in 376 msec 2023-07-28 20:53:59,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-28 20:53:59,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=bf5869d7e4614f83b0a59568590bcd9a, ASSIGN in 613 msec 2023-07-28 20:53:59,716 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-28 20:53:59,736 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577639736"}]},"ts":"1690577639736"} 2023-07-28 20:53:59,750 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-28 20:53:59,777 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-28 20:53:59,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.4030 sec 2023-07-28 20:53:59,832 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-28 20:53:59,851 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-28 20:53:59,851 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:53:59,946 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-28 20:54:00,032 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-28 20:54:00,053 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-28 20:54:00,076 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 156 msec 2023-07-28 20:54:00,098 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-28 20:54:00,158 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-28 20:54:00,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 88 msec 2023-07-28 20:54:00,208 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-28 20:54:00,238 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-28 20:54:00,239 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 9.100sec 2023-07-28 20:54:00,241 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-28 20:54:00,243 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-28 20:54:00,244 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-28 20:54:00,248 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,37137,1690577628154-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-28 20:54:00,249 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,37137,1690577628154-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-28 20:54:00,296 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-28 20:54:00,328 DEBUG [Listener at localhost.localdomain/37723] zookeeper.ReadOnlyZKClient(139): Connect 0x76b36038 to 127.0.0.1:63165 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-28 20:54:00,387 DEBUG [Listener at localhost.localdomain/37723] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c1b8776, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-28 20:54:00,468 DEBUG [hconnection-0x337023c4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-28 20:54:00,494 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-28 20:54:00,516 INFO [Listener at localhost.localdomain/37723] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,37137,1690577628154 2023-07-28 20:54:00,516 INFO [Listener at localhost.localdomain/37723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:54:00,541 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-28 20:54:00,541 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:54:00,565 INFO [Listener at localhost.localdomain/37723] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-28 20:54:00,624 WARN [Listener at localhost.localdomain/37723] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-28 20:54:00,632 WARN [Listener at localhost.localdomain/37723] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:54:00,635 INFO [Listener at localhost.localdomain/37723] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:54:00,646 INFO [Listener at localhost.localdomain/37723] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/java.io.tmpdir/Jetty_localhost_38043_datanode____h9tclt/webapp 2023-07-28 20:54:00,888 INFO [Listener at localhost.localdomain/37723] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38043 2023-07-28 20:54:00,972 WARN [Listener at localhost.localdomain/38923] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:54:01,156 WARN [Listener at localhost.localdomain/38923] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-28 20:54:01,173 WARN [Listener at localhost.localdomain/38923] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:54:01,176 INFO [Listener at localhost.localdomain/38923] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:54:01,186 INFO [Listener at localhost.localdomain/38923] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/java.io.tmpdir/Jetty_localhost_34949_datanode____x87zz8/webapp 2023-07-28 20:54:01,493 INFO [Listener at localhost.localdomain/38923] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34949 2023-07-28 20:54:01,543 WARN [Listener at localhost.localdomain/36861] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:54:01,624 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3dbf495c582def70: Processing first storage report for DS-bfdd4b7b-2a88-431c-b43e-857495f40454 from datanode f8cb4407-3a70-437d-b636-9ca609993f42 2023-07-28 20:54:01,625 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3dbf495c582def70: from storage DS-bfdd4b7b-2a88-431c-b43e-857495f40454 node DatanodeRegistration(127.0.0.1:37917, datanodeUuid=f8cb4407-3a70-437d-b636-9ca609993f42, infoPort=41501, infoSecurePort=0, ipcPort=38923, storageInfo=lv=-57;cid=testClusterID;nsid=1263892384;c=1690577621927), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:54:01,625 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3dbf495c582def70: Processing first storage report for DS-586956d2-4c24-4238-9051-a928403a97fb from datanode f8cb4407-3a70-437d-b636-9ca609993f42 2023-07-28 20:54:01,625 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3dbf495c582def70: from storage DS-586956d2-4c24-4238-9051-a928403a97fb node DatanodeRegistration(127.0.0.1:37917, datanodeUuid=f8cb4407-3a70-437d-b636-9ca609993f42, infoPort=41501, infoSecurePort=0, ipcPort=38923, storageInfo=lv=-57;cid=testClusterID;nsid=1263892384;c=1690577621927), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:54:01,677 WARN [Listener at localhost.localdomain/36861] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-28 20:54:01,696 WARN [Listener at localhost.localdomain/36861] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:54:01,698 INFO [Listener at localhost.localdomain/36861] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:54:01,726 INFO [Listener at localhost.localdomain/36861] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/java.io.tmpdir/Jetty_localhost_35429_datanode____.c4f1s0/webapp 2023-07-28 20:54:01,985 INFO [Listener at localhost.localdomain/36861] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35429 2023-07-28 20:54:02,040 WARN [Listener at localhost.localdomain/44633] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:54:02,128 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x41c2b25fed70d4ec: Processing first storage report for DS-e515a7b3-01e7-4330-8517-4c1cca3ba8fc from datanode aba7fb1b-da52-46af-b380-e80b2af21dd9 2023-07-28 20:54:02,129 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x41c2b25fed70d4ec: from storage DS-e515a7b3-01e7-4330-8517-4c1cca3ba8fc node DatanodeRegistration(127.0.0.1:36235, datanodeUuid=aba7fb1b-da52-46af-b380-e80b2af21dd9, infoPort=42473, infoSecurePort=0, ipcPort=36861, storageInfo=lv=-57;cid=testClusterID;nsid=1263892384;c=1690577621927), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:54:02,129 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x41c2b25fed70d4ec: Processing first storage report for DS-469bf4cc-9e8a-41df-977a-ceec58b6b1d0 from datanode aba7fb1b-da52-46af-b380-e80b2af21dd9 2023-07-28 20:54:02,129 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x41c2b25fed70d4ec: from storage DS-469bf4cc-9e8a-41df-977a-ceec58b6b1d0 node DatanodeRegistration(127.0.0.1:36235, datanodeUuid=aba7fb1b-da52-46af-b380-e80b2af21dd9, infoPort=42473, infoSecurePort=0, ipcPort=36861, storageInfo=lv=-57;cid=testClusterID;nsid=1263892384;c=1690577621927), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-28 20:54:02,163 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-28 20:54:02,168 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-28 20:54:02,346 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5a37b1bb30b4b747: Processing first storage report for DS-20645470-df95-4511-a5c7-91f511192cbe from datanode add8f56a-bdba-4c8c-97d9-07ed84915ff2 2023-07-28 20:54:02,346 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5a37b1bb30b4b747: from storage DS-20645470-df95-4511-a5c7-91f511192cbe node DatanodeRegistration(127.0.0.1:33185, datanodeUuid=add8f56a-bdba-4c8c-97d9-07ed84915ff2, infoPort=40603, infoSecurePort=0, ipcPort=44633, storageInfo=lv=-57;cid=testClusterID;nsid=1263892384;c=1690577621927), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:54:02,346 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5a37b1bb30b4b747: Processing first storage report for DS-6891c0c1-2a81-4313-908b-3d86c4243870 from datanode add8f56a-bdba-4c8c-97d9-07ed84915ff2 2023-07-28 20:54:02,346 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5a37b1bb30b4b747: from storage DS-6891c0c1-2a81-4313-908b-3d86c4243870 node DatanodeRegistration(127.0.0.1:33185, datanodeUuid=add8f56a-bdba-4c8c-97d9-07ed84915ff2, infoPort=40603, infoSecurePort=0, ipcPort=44633, storageInfo=lv=-57;cid=testClusterID;nsid=1263892384;c=1690577621927), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:54:02,446 DEBUG [Listener at localhost.localdomain/44633] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-28 20:54:02,481 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-28 20:54:02,496 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37137] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-07-28 20:54:02,496 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37137] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-07-28 20:54:02,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37137] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-28 20:54:02,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37137] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath 2023-07-28 20:54:02,543 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_PRE_OPERATION 2023-07-28 20:54:02,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37137] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRollOnDatanodeDeath" procId is: 9 2023-07-28 20:54:02,560 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-28 20:54:02,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37137] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-28 20:54:02,576 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176 2023-07-28 20:54:02,587 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176 empty. 2023-07-28 20:54:02,594 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176 2023-07-28 20:54:02,594 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRollOnDatanodeDeath regions 2023-07-28 20:54:02,711 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/.tmp/data/default/TestLogRolling-testLogRollOnDatanodeDeath/.tabledesc/.tableinfo.0000000001 2023-07-28 20:54:02,725 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0288f6c467f27b99a5d0747537be3176, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRollOnDatanodeDeath', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/.tmp 2023-07-28 20:54:02,896 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:54:02,897 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1604): Closing 0288f6c467f27b99a5d0747537be3176, disabling compactions & flushes 2023-07-28 20:54:02,897 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:02,897 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:02,897 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. after waiting 0 ms 2023-07-28 20:54:02,897 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:02,897 INFO [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:02,897 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRollOnDatanodeDeath-pool-0] regionserver.HRegion(1558): Region close journal for 0288f6c467f27b99a5d0747537be3176: 2023-07-28 20:54:02,933 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ADD_TO_META 2023-07-28 20:54:02,960 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1690577642951"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690577642951"}]},"ts":"1690577642951"} 2023-07-28 20:54:02,980 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-28 20:54:02,986 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-28 20:54:02,989 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577642987"}]},"ts":"1690577642987"} 2023-07-28 20:54:03,002 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLING in hbase:meta 2023-07-28 20:54:03,015 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=0288f6c467f27b99a5d0747537be3176, ASSIGN}] 2023-07-28 20:54:03,024 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=0288f6c467f27b99a5d0747537be3176, ASSIGN 2023-07-28 20:54:03,036 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=0288f6c467f27b99a5d0747537be3176, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,41029,1690577630761; forceNewPlan=false, retain=false 2023-07-28 20:54:03,193 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0288f6c467f27b99a5d0747537be3176, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:54:03,194 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1690577643193"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690577643193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690577643193"}]},"ts":"1690577643193"} 2023-07-28 20:54:03,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0288f6c467f27b99a5d0747537be3176, server=jenkins-hbase17.apache.org,41029,1690577630761}] 2023-07-28 20:54:03,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:03,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0288f6c467f27b99a5d0747537be3176, NAME => 'TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176.', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:54:03,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRollOnDatanodeDeath 0288f6c467f27b99a5d0747537be3176 2023-07-28 20:54:03,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:54:03,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0288f6c467f27b99a5d0747537be3176 2023-07-28 20:54:03,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0288f6c467f27b99a5d0747537be3176 2023-07-28 20:54:03,399 INFO [StoreOpener-0288f6c467f27b99a5d0747537be3176-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0288f6c467f27b99a5d0747537be3176 2023-07-28 20:54:03,414 DEBUG [StoreOpener-0288f6c467f27b99a5d0747537be3176-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176/info 2023-07-28 20:54:03,415 DEBUG [StoreOpener-0288f6c467f27b99a5d0747537be3176-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176/info 2023-07-28 20:54:03,415 INFO [StoreOpener-0288f6c467f27b99a5d0747537be3176-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0288f6c467f27b99a5d0747537be3176 columnFamilyName info 2023-07-28 20:54:03,417 INFO [StoreOpener-0288f6c467f27b99a5d0747537be3176-1] regionserver.HStore(310): Store=0288f6c467f27b99a5d0747537be3176/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:54:03,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176 2023-07-28 20:54:03,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176 2023-07-28 20:54:03,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0288f6c467f27b99a5d0747537be3176 2023-07-28 20:54:03,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:54:03,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0288f6c467f27b99a5d0747537be3176; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=836149, jitterRate=0.06321945786476135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:54:03,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0288f6c467f27b99a5d0747537be3176: 2023-07-28 20:54:03,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176., pid=11, masterSystemTime=1690577643367 2023-07-28 20:54:03,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:03,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:03,484 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0288f6c467f27b99a5d0747537be3176, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:54:03,485 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176.","families":{"info":[{"qualifier":"regioninfo","vlen":75,"tag":[],"timestamp":"1690577643484"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690577643484"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690577643484"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690577643484"}]},"ts":"1690577643484"} 2023-07-28 20:54:03,500 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-28 20:54:03,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-28 20:54:03,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0288f6c467f27b99a5d0747537be3176, server=jenkins-hbase17.apache.org,41029,1690577630761 in 295 msec 2023-07-28 20:54:03,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-28 20:54:03,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRollOnDatanodeDeath, region=0288f6c467f27b99a5d0747537be3176, ASSIGN in 521 msec 2023-07-28 20:54:03,547 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-28 20:54:03,547 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRollOnDatanodeDeath","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577643547"}]},"ts":"1690577643547"} 2023-07-28 20:54:03,551 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRollOnDatanodeDeath, state=ENABLED in hbase:meta 2023-07-28 20:54:03,558 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath execute state=CREATE_TABLE_POST_OPERATION 2023-07-28 20:54:03,580 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRollOnDatanodeDeath in 1.0560 sec 2023-07-28 20:54:08,186 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRollOnDatanodeDeath' 2023-07-28 20:54:08,896 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-28 20:54:12,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37137] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-28 20:54:12,601 INFO [Listener at localhost.localdomain/44633] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRollOnDatanodeDeath, procId: 9 completed 2023-07-28 20:54:12,601 DEBUG [Listener at localhost.localdomain/44633] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestLogRolling-testLogRollOnDatanodeDeath get assigned. Timeout = 60000ms 2023-07-28 20:54:12,604 INFO [Listener at localhost.localdomain/44633] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-28 20:54:12,634 INFO [Listener at localhost.localdomain/44633] hbase.HBaseTestingUtility(3484): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned to meta. Checking AM states. 2023-07-28 20:54:12,635 INFO [Listener at localhost.localdomain/44633] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-28 20:54:12,635 INFO [Listener at localhost.localdomain/44633] hbase.HBaseTestingUtility(3504): All regions for table TestLogRolling-testLogRollOnDatanodeDeath assigned. 2023-07-28 20:54:12,655 DEBUG [Listener at localhost.localdomain/44633] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRollOnDatanodeDeath 2023-07-28 20:54:12,657 DEBUG [Listener at localhost.localdomain/44633] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:12,657 WARN [Listener at localhost.localdomain/44633] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-28 20:54:12,706 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-1244989002_17 at /127.0.0.1:40646 [Receiving block BP-1939426412-136.243.18.41-1690577621927:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:46219:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:40646 dst: /127.0.0.1:46219 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:12,713 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1011323148_17 at /127.0.0.1:40616 [Receiving block BP-1939426412-136.243.18.41-1690577621927:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:46219:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:40616 dst: /127.0.0.1:46219 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:12,714 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-1244989002_17 at /127.0.0.1:40644 [Receiving block BP-1939426412-136.243.18.41-1690577621927:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:46219:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:40644 dst: /127.0.0.1:46219 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:12,719 INFO [Listener at localhost.localdomain/44633] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-28 20:54:12,822 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_1011323148_17 at /127.0.0.1:39178 [Receiving block BP-1939426412-136.243.18.41-1690577621927:blk_1073741829_1005]] datanode.DataXceiver(323): 127.0.0.1:41633:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:39178 dst: /127.0.0.1:41633 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:12,828 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-1244989002_17 at /127.0.0.1:39222 [Receiving block BP-1939426412-136.243.18.41-1690577621927:blk_1073741832_1008]] datanode.DataXceiver(323): 127.0.0.1:41633:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:39222 dst: /127.0.0.1:41633 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:12,830 ERROR [DataXceiver for client DFSClient_NONMAPREDUCE_-1244989002_17 at /127.0.0.1:39238 [Receiving block BP-1939426412-136.243.18.41-1690577621927:blk_1073741833_1009]] datanode.DataXceiver(323): 127.0.0.1:41633:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:39238 dst: /127.0.0.1:41633 java.io.InterruptedIOException: Interrupted while waiting for IO on channel java.nio.channels.SocketChannel[closed]. 60000 millis timeout left. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:342) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:12,830 WARN [BP-1939426412-136.243.18.41-1690577621927 heartbeating to localhost.localdomain/127.0.0.1:44723] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-28 20:54:12,831 WARN [BP-1939426412-136.243.18.41-1690577621927 heartbeating to localhost.localdomain/127.0.0.1:44723] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1939426412-136.243.18.41-1690577621927 (Datanode Uuid 81d55b81-884d-4631-a519-1a4456408b4a) service to localhost.localdomain/127.0.0.1:44723 2023-07-28 20:54:12,833 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/dfs/data/data3/current/BP-1939426412-136.243.18.41-1690577621927] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:54:12,833 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/dfs/data/data4/current/BP-1939426412-136.243.18.41-1690577621927] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:54:12,848 WARN [Listener at localhost.localdomain/44633] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-28 20:54:12,852 WARN [Listener at localhost.localdomain/44633] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:54:12,853 INFO [Listener at localhost.localdomain/44633] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:54:12,862 INFO [Listener at localhost.localdomain/44633] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/java.io.tmpdir/Jetty_localhost_42777_datanode____794osg/webapp 2023-07-28 20:54:12,968 INFO [Listener at localhost.localdomain/44633] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42777 2023-07-28 20:54:12,997 WARN [Listener at localhost.localdomain/43311] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:54:13,062 WARN [AsyncFSWAL-0-hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3-prefix:jenkins-hbase17.apache.org,41029,1690577630761] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:13,064 DEBUG [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase17.apache.org%2C41029%2C1690577630761:(num 1690577636805) roll requested 2023-07-28 20:54:13,096 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36235,DS-e515a7b3-01e7-4330-8517-4c1cca3ba8fc,DISK] 2023-07-28 20:54:13,102 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46219,DS-ac39038b-f25c-487c-8d25-0b27ddf46695,DISK] 2023-07-28 20:54:13,148 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.1690577636805 with entries=6, filesize=3.20 KB; new WAL /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.1690577653064 2023-07-28 20:54:13,156 DEBUG [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46219,DS-ac39038b-f25c-487c-8d25-0b27ddf46695,DISK], DatanodeInfoWithStorage[127.0.0.1:36235,DS-e515a7b3-01e7-4330-8517-4c1cca3ba8fc,DISK]] 2023-07-28 20:54:13,157 DEBUG [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.1690577636805 is not closed yet, will try archiving it next time 2023-07-28 20:54:13,160 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:13,160 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:13,170 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.1690577636805 2023-07-28 20:54:13,179 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-28 20:54:13,179 INFO [Listener at localhost.localdomain/43311] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-28 20:54:13,201 WARN [IPC Server handler 2 on default port 44723] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.1690577636805 has not been closed. Lease recovery is in progress. RecoveryId = 1015 for block blk_1073741832_1008 2023-07-28 20:54:13,205 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.1690577636805 after 35ms 2023-07-28 20:54:13,216 DEBUG [Listener at localhost.localdomain/43311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76b36038 to 127.0.0.1:63165 2023-07-28 20:54:13,216 DEBUG [Listener at localhost.localdomain/43311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:54:13,217 DEBUG [Listener at localhost.localdomain/43311] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-28 20:54:13,217 DEBUG [Listener at localhost.localdomain/43311] util.JVMClusterUtil(257): Found active master hash=102763732, stopped=false 2023-07-28 20:54:13,217 INFO [Listener at localhost.localdomain/43311] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,37137,1690577628154 2023-07-28 20:54:13,283 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x101adb4e3910001, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-28 20:54:13,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x101adb4e3910001, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:54:13,296 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-28 20:54:13,296 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:54:13,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:54:13,300 INFO [Listener at localhost.localdomain/43311] procedure2.ProcedureExecutor(629): Stopping 2023-07-28 20:54:13,308 DEBUG [Listener at localhost.localdomain/43311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e3d32d9 to 127.0.0.1:63165 2023-07-28 20:54:13,308 DEBUG [Listener at localhost.localdomain/43311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:54:13,309 INFO [Listener at localhost.localdomain/43311] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,41029,1690577630761' ***** 2023-07-28 20:54:13,309 INFO [Listener at localhost.localdomain/43311] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-28 20:54:13,313 INFO [RS:0;jenkins-hbase17:41029] regionserver.HeapMemoryManager(220): Stopping 2023-07-28 20:54:13,313 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-28 20:54:13,314 INFO [RS:0;jenkins-hbase17:41029] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-28 20:54:13,314 INFO [RS:0;jenkins-hbase17:41029] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-28 20:54:13,314 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(3305): Received CLOSE for 0288f6c467f27b99a5d0747537be3176 2023-07-28 20:54:13,315 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(3305): Received CLOSE for bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:54:13,319 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:54:13,319 DEBUG [RS:0;jenkins-hbase17:41029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24af4ab7 to 127.0.0.1:63165 2023-07-28 20:54:13,319 DEBUG [RS:0;jenkins-hbase17:41029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:54:13,320 INFO [RS:0;jenkins-hbase17:41029] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-28 20:54:13,320 INFO [RS:0;jenkins-hbase17:41029] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-28 20:54:13,320 INFO [RS:0;jenkins-hbase17:41029] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-28 20:54:13,320 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-28 20:54:13,324 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-28 20:54:13,324 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1478): Online Regions={0288f6c467f27b99a5d0747537be3176=TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176., 1588230740=hbase:meta,,1.1588230740, bf5869d7e4614f83b0a59568590bcd9a=hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a.} 2023-07-28 20:54:13,326 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1504): Waiting on 0288f6c467f27b99a5d0747537be3176, 1588230740, bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:54:13,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0288f6c467f27b99a5d0747537be3176, disabling compactions & flushes 2023-07-28 20:54:13,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:13,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:13,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. after waiting 0 ms 2023-07-28 20:54:13,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:13,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 0288f6c467f27b99a5d0747537be3176 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-07-28 20:54:13,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-28 20:54:13,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-28 20:54:13,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-28 20:54:13,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-28 20:54:13,361 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-28 20:54:13,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.93 KB heapSize=5.45 KB 2023-07-28 20:54:13,367 WARN [AsyncFSWAL-0-hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3-prefix:jenkins-hbase17.apache.org,41029,1690577630761.meta] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:13,369 DEBUG [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta:.meta(num 1690577637581) roll requested 2023-07-28 20:54:13,421 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33185,DS-20645470-df95-4511-a5c7-91f511192cbe,DISK] 2023-07-28 20:54:13,421 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37917,DS-bfdd4b7b-2a88-431c-b43e-857495f40454,DISK] 2023-07-28 20:54:13,450 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta.1690577637581.meta with entries=12, filesize=3.87 KB; new WAL /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta.1690577653369.meta 2023-07-28 20:54:13,451 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x38e8a1a73df5db0d: Processing first storage report for DS-4006dc1c-a56d-4623-a501-af6cf7338d37 from datanode 81d55b81-884d-4631-a519-1a4456408b4a 2023-07-28 20:54:13,452 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x38e8a1a73df5db0d: from storage DS-4006dc1c-a56d-4623-a501-af6cf7338d37 node DatanodeRegistration(127.0.0.1:43399, datanodeUuid=81d55b81-884d-4631-a519-1a4456408b4a, infoPort=39707, infoSecurePort=0, ipcPort=43311, storageInfo=lv=-57;cid=testClusterID;nsid=1263892384;c=1690577621927), blocks: 7, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-28 20:54:13,453 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x38e8a1a73df5db0d: Processing first storage report for DS-7c6b6893-3ad4-4f84-9f6a-028933ff3fff from datanode 81d55b81-884d-4631-a519-1a4456408b4a 2023-07-28 20:54:13,453 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x38e8a1a73df5db0d: from storage DS-7c6b6893-3ad4-4f84-9f6a-028933ff3fff node DatanodeRegistration(127.0.0.1:43399, datanodeUuid=81d55b81-884d-4631-a519-1a4456408b4a, infoPort=39707, infoSecurePort=0, ipcPort=43311, storageInfo=lv=-57;cid=testClusterID;nsid=1263892384;c=1690577621927), blocks: 6, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:54:13,459 DEBUG [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33185,DS-20645470-df95-4511-a5c7-91f511192cbe,DISK], DatanodeInfoWithStorage[127.0.0.1:37917,DS-bfdd4b7b-2a88-431c-b43e-857495f40454,DISK]] 2023-07-28 20:54:13,468 DEBUG [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta.1690577637581.meta is not closed yet, will try archiving it next time 2023-07-28 20:54:13,471 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:13,472 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:13,472 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta.1690577637581.meta 2023-07-28 20:54:13,474 WARN [IPC Server handler 1 on default port 44723] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta.1690577637581.meta has not been closed. Lease recovery is in progress. RecoveryId = 1017 for block blk_1073741833_1009 2023-07-28 20:54:13,479 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta.1690577637581.meta after 7ms 2023-07-28 20:54:13,495 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-28 20:54:13,495 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-28 20:54:13,526 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1504): Waiting on 0288f6c467f27b99a5d0747537be3176, 1588230740, bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:54:13,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176/.tmp/info/9f615c18fcac4d009792a4286038ea31 2023-07-28 20:54:13,609 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.69 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/.tmp/info/09e8ac838e824df791bb5f242a504894 2023-07-28 20:54:13,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176/.tmp/info/9f615c18fcac4d009792a4286038ea31 as hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176/info/9f615c18fcac4d009792a4286038ea31 2023-07-28 20:54:13,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176/info/9f615c18fcac4d009792a4286038ea31, entries=2, sequenceid=6, filesize=6.8 K 2023-07-28 20:54:13,727 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1504): Waiting on 0288f6c467f27b99a5d0747537be3176, 1588230740, bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:54:13,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for 0288f6c467f27b99a5d0747537be3176 in 391ms, sequenceid=6, compaction requested=false 2023-07-28 20:54:13,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/default/TestLogRolling-testLogRollOnDatanodeDeath/0288f6c467f27b99a5d0747537be3176/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-28 20:54:13,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:13,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0288f6c467f27b99a5d0747537be3176: 2023-07-28 20:54:13,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRollOnDatanodeDeath,,1690577642495.0288f6c467f27b99a5d0747537be3176. 2023-07-28 20:54:13,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing bf5869d7e4614f83b0a59568590bcd9a, disabling compactions & flushes 2023-07-28 20:54:13,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. 2023-07-28 20:54:13,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. 2023-07-28 20:54:13,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. after waiting 0 ms 2023-07-28 20:54:13,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. 2023-07-28 20:54:13,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing bf5869d7e4614f83b0a59568590bcd9a 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-28 20:54:13,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a/.tmp/info/3401f99929e94938a9b05f507b9014ba 2023-07-28 20:54:13,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a/.tmp/info/3401f99929e94938a9b05f507b9014ba as hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a/info/3401f99929e94938a9b05f507b9014ba 2023-07-28 20:54:13,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a/info/3401f99929e94938a9b05f507b9014ba, entries=2, sequenceid=6, filesize=4.8 K 2023-07-28 20:54:13,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for bf5869d7e4614f83b0a59568590bcd9a in 101ms, sequenceid=6, compaction requested=false 2023-07-28 20:54:13,931 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1504): Waiting on 1588230740, bf5869d7e4614f83b0a59568590bcd9a 2023-07-28 20:54:13,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/namespace/bf5869d7e4614f83b0a59568590bcd9a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-28 20:54:13,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. 2023-07-28 20:54:13,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for bf5869d7e4614f83b0a59568590bcd9a: 2023-07-28 20:54:13,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690577638372.bf5869d7e4614f83b0a59568590bcd9a. 2023-07-28 20:54:14,131 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-28 20:54:14,221 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=240 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/.tmp/table/167e2ca444d0402380f5731905434728 2023-07-28 20:54:14,237 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/.tmp/info/09e8ac838e824df791bb5f242a504894 as hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/info/09e8ac838e824df791bb5f242a504894 2023-07-28 20:54:14,256 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/info/09e8ac838e824df791bb5f242a504894, entries=20, sequenceid=14, filesize=7.4 K 2023-07-28 20:54:14,268 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/.tmp/table/167e2ca444d0402380f5731905434728 as hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/table/167e2ca444d0402380f5731905434728 2023-07-28 20:54:14,287 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/table/167e2ca444d0402380f5731905434728, entries=4, sequenceid=14, filesize=4.8 K 2023-07-28 20:54:14,292 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/2998, heapSize ~5.16 KB/5288, currentSize=0 B/0 for 1588230740 in 931ms, sequenceid=14, compaction requested=false 2023-07-28 20:54:14,332 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-28 20:54:14,332 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-28 20:54:14,332 DEBUG [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-28 20:54:14,336 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-07-28 20:54:14,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-28 20:54:14,339 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-28 20:54:14,339 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-28 20:54:14,339 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-28 20:54:14,501 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-28 20:54:14,532 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,41029,1690577630761; all regions closed. 2023-07-28 20:54:17,206 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.1690577636805 after 4036ms 2023-07-28 20:54:17,207 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.1690577636805 to hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/oldWALs/jenkins-hbase17.apache.org%2C41029%2C1690577630761.1690577636805 2023-07-28 20:54:17,480 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta.1690577637581.meta after 4008ms 2023-07-28 20:54:17,481 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/WALs/jenkins-hbase17.apache.org,41029,1690577630761/jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta.1690577637581.meta to hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/oldWALs/jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta.1690577637581.meta 2023-07-28 20:54:17,487 DEBUG [RS:0;jenkins-hbase17:41029] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/oldWALs 2023-07-28 20:54:17,488 INFO [RS:0;jenkins-hbase17:41029] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C41029%2C1690577630761.meta:.meta(num 1690577653369) 2023-07-28 20:54:17,498 DEBUG [RS:0;jenkins-hbase17:41029] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/oldWALs 2023-07-28 20:54:17,498 INFO [RS:0;jenkins-hbase17:41029] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C41029%2C1690577630761:(num 1690577653064) 2023-07-28 20:54:17,498 DEBUG [RS:0;jenkins-hbase17:41029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:54:17,498 INFO [RS:0;jenkins-hbase17:41029] regionserver.LeaseManager(133): Closed leases 2023-07-28 20:54:17,498 INFO [RS:0;jenkins-hbase17:41029] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-28 20:54:17,498 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-28 20:54:17,500 INFO [RS:0;jenkins-hbase17:41029] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:41029 2023-07-28 20:54:17,508 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-28 20:54:17,508 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x101adb4e3910001, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,41029,1690577630761 2023-07-28 20:54:17,508 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x101adb4e3910001, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-28 20:54:17,509 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,41029,1690577630761] 2023-07-28 20:54:17,509 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,41029,1690577630761; numProcessing=1 2023-07-28 20:54:17,512 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,41029,1690577630761 already deleted, retry=false 2023-07-28 20:54:17,512 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,41029,1690577630761 expired; onlineServers=0 2023-07-28 20:54:17,512 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,37137,1690577628154' ***** 2023-07-28 20:54:17,512 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-28 20:54:17,513 DEBUG [M:0;jenkins-hbase17:37137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@471d06ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-28 20:54:17,513 INFO [M:0;jenkins-hbase17:37137] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,37137,1690577628154 2023-07-28 20:54:17,513 INFO [M:0;jenkins-hbase17:37137] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,37137,1690577628154; all regions closed. 2023-07-28 20:54:17,513 DEBUG [M:0;jenkins-hbase17:37137] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:54:17,513 DEBUG [M:0;jenkins-hbase17:37137] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-28 20:54:17,513 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-28 20:54:17,513 DEBUG [M:0;jenkins-hbase17:37137] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-28 20:54:17,513 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690577635790] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690577635790,5,FailOnTimeoutGroup] 2023-07-28 20:54:17,513 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690577635791] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690577635791,5,FailOnTimeoutGroup] 2023-07-28 20:54:17,514 INFO [M:0;jenkins-hbase17:37137] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-28 20:54:17,514 INFO [M:0;jenkins-hbase17:37137] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-28 20:54:17,515 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-28 20:54:17,515 INFO [M:0;jenkins-hbase17:37137] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-28 20:54:17,515 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:54:17,515 DEBUG [M:0;jenkins-hbase17:37137] master.HMaster(1512): Stopping service threads 2023-07-28 20:54:17,515 INFO [M:0;jenkins-hbase17:37137] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-28 20:54:17,516 ERROR [M:0;jenkins-hbase17:37137] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] 2023-07-28 20:54:17,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-28 20:54:17,516 INFO [M:0;jenkins-hbase17:37137] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-28 20:54:17,516 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-28 20:54:17,517 DEBUG [M:0;jenkins-hbase17:37137] zookeeper.ZKUtil(398): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-28 20:54:17,517 WARN [M:0;jenkins-hbase17:37137] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-28 20:54:17,517 INFO [M:0;jenkins-hbase17:37137] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-28 20:54:17,517 INFO [M:0;jenkins-hbase17:37137] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-28 20:54:17,518 DEBUG [M:0;jenkins-hbase17:37137] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-28 20:54:17,518 INFO [M:0;jenkins-hbase17:37137] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:54:17,518 DEBUG [M:0;jenkins-hbase17:37137] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:54:17,518 DEBUG [M:0;jenkins-hbase17:37137] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-28 20:54:17,518 DEBUG [M:0;jenkins-hbase17:37137] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:54:17,518 INFO [M:0;jenkins-hbase17:37137] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.11 KB heapSize=45.77 KB 2023-07-28 20:54:17,518 WARN [AsyncFSWAL-0-hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData-prefix:jenkins-hbase17.apache.org,37137,1690577628154] wal.AsyncFSWAL(305): sync failed java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.sync(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:419) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:631) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:17,519 DEBUG [master:store-WAL-Roller] wal.AbstractWALRoller(197): WAL AsyncFSWAL jenkins-hbase17.apache.org%2C37137%2C1690577628154:(num 1690577633532) roll requested 2023-07-28 20:54:17,537 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37917,DS-bfdd4b7b-2a88-431c-b43e-857495f40454,DISK] 2023-07-28 20:54:17,538 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46219,DS-ac39038b-f25c-487c-8d25-0b27ddf46695,DISK] 2023-07-28 20:54:17,541 INFO [master:store-WAL-Roller] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/WALs/jenkins-hbase17.apache.org,37137,1690577628154/jenkins-hbase17.apache.org%2C37137%2C1690577628154.1690577633532 with entries=89, filesize=43.96 KB; new WAL /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/WALs/jenkins-hbase17.apache.org,37137,1690577628154/jenkins-hbase17.apache.org%2C37137%2C1690577628154.1690577657519 2023-07-28 20:54:17,544 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37917,DS-bfdd4b7b-2a88-431c-b43e-857495f40454,DISK], DatanodeInfoWithStorage[127.0.0.1:46219,DS-ac39038b-f25c-487c-8d25-0b27ddf46695,DISK]] 2023-07-28 20:54:17,544 DEBUG [master:store-WAL-Roller] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/WALs/jenkins-hbase17.apache.org,37137,1690577628154/jenkins-hbase17.apache.org%2C37137%2C1690577628154.1690577633532 is not closed yet, will try archiving it next time 2023-07-28 20:54:17,544 WARN [Close-WAL-Writer-0] wal.AbstractProtobufLogWriter(237): Failed to write trailer, non-fatal, continuing... java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush0(FanOutOneBlockAsyncDFSOutput.java:436) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.flush(FanOutOneBlockAsyncDFSOutput.java:525) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.lambda$writeWALTrailerAndMagic$3(AsyncProtobufLogWriter.java:252) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:208) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALTrailerAndMagic(AsyncProtobufLogWriter.java:243) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.writeWALTrailer(AbstractProtobufLogWriter.java:234) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:17,545 WARN [Close-WAL-Writer-0] wal.AsyncProtobufLogWriter(171): normal close failed, try recover java.io.IOException: stream already broken at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:533) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.close(FanOutOneBlockAsyncDFSOutput.java:581) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.close(AsyncProtobufLogWriter.java:169) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.lambda$closeWriter$5(AsyncFSWAL.java:746) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-07-28 20:54:17,545 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/WALs/jenkins-hbase17.apache.org,37137,1690577628154/jenkins-hbase17.apache.org%2C37137%2C1690577628154.1690577633532 2023-07-28 20:54:17,546 WARN [IPC Server handler 4 on default port 44723] namenode.FSNamesystem(3291): DIR* NameSystem.internalReleaseLease: File /user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/WALs/jenkins-hbase17.apache.org,37137,1690577628154/jenkins-hbase17.apache.org%2C37137%2C1690577628154.1690577633532 has not been closed. Lease recovery is in progress. RecoveryId = 1023 for block blk_1073741829_1005 2023-07-28 20:54:17,547 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Failed to recover lease, attempt=0 on file=/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/WALs/jenkins-hbase17.apache.org,37137,1690577628154/jenkins-hbase17.apache.org%2C37137%2C1690577628154.1690577633532 after 2ms 2023-07-28 20:54:17,563 INFO [M:0;jenkins-hbase17:37137] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.11 KB at sequenceid=91 (bloomFilter=true), to=hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bac2eaa509d84b1f897e409195cc7a68 2023-07-28 20:54:17,572 DEBUG [M:0;jenkins-hbase17:37137] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bac2eaa509d84b1f897e409195cc7a68 as hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bac2eaa509d84b1f897e409195cc7a68 2023-07-28 20:54:17,580 INFO [M:0;jenkins-hbase17:37137] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bac2eaa509d84b1f897e409195cc7a68, entries=11, sequenceid=91, filesize=7.0 K 2023-07-28 20:54:17,582 INFO [M:0;jenkins-hbase17:37137] regionserver.HRegion(2948): Finished flush of dataSize ~38.11 KB/39023, heapSize ~45.75 KB/46848, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 64ms, sequenceid=91, compaction requested=false 2023-07-28 20:54:17,584 INFO [M:0;jenkins-hbase17:37137] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:54:17,584 DEBUG [M:0;jenkins-hbase17:37137] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-28 20:54:17,610 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x101adb4e3910001, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:54:17,610 INFO [RS:0;jenkins-hbase17:41029] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,41029,1690577630761; zookeeper connection closed. 2023-07-28 20:54:17,610 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x101adb4e3910001, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:54:17,610 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d68e42c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d68e42c 2023-07-28 20:54:17,611 INFO [Listener at localhost.localdomain/43311] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-28 20:54:18,366 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-28 20:54:19,336 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-28 20:54:21,548 INFO [Close-WAL-Writer-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=1 on file=/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/WALs/jenkins-hbase17.apache.org,37137,1690577628154/jenkins-hbase17.apache.org%2C37137%2C1690577628154.1690577633532 after 4003ms 2023-07-28 20:54:21,548 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/WALs/jenkins-hbase17.apache.org,37137,1690577628154/jenkins-hbase17.apache.org%2C37137%2C1690577628154.1690577633532 to hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/oldWALs/jenkins-hbase17.apache.org%2C37137%2C1690577628154.1690577633532 2023-07-28 20:54:21,556 INFO [WAL-Archive-0] region.MasterRegionUtils(50): Moved hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/MasterData/oldWALs/jenkins-hbase17.apache.org%2C37137%2C1690577628154.1690577633532 to hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/oldWALs/jenkins-hbase17.apache.org%2C37137%2C1690577628154.1690577633532$masterlocalwal$ 2023-07-28 20:54:21,556 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-28 20:54:21,556 INFO [M:0;jenkins-hbase17:37137] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-28 20:54:21,557 INFO [M:0;jenkins-hbase17:37137] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:37137 2023-07-28 20:54:21,559 DEBUG [M:0;jenkins-hbase17:37137] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,37137,1690577628154 already deleted, retry=false 2023-07-28 20:54:21,661 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:54:21,661 DEBUG [Listener at localhost.localdomain/37723-EventThread] zookeeper.ZKWatcher(600): master:37137-0x101adb4e3910000, quorum=127.0.0.1:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:54:21,661 INFO [M:0;jenkins-hbase17:37137] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,37137,1690577628154; zookeeper connection closed. 2023-07-28 20:54:21,663 WARN [Listener at localhost.localdomain/43311] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-28 20:54:21,698 INFO [Listener at localhost.localdomain/43311] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-28 20:54:21,810 WARN [BP-1939426412-136.243.18.41-1690577621927 heartbeating to localhost.localdomain/127.0.0.1:44723] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-28 20:54:21,810 WARN [BP-1939426412-136.243.18.41-1690577621927 heartbeating to localhost.localdomain/127.0.0.1:44723] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1939426412-136.243.18.41-1690577621927 (Datanode Uuid 81d55b81-884d-4631-a519-1a4456408b4a) service to localhost.localdomain/127.0.0.1:44723 2023-07-28 20:54:21,811 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/dfs/data/data3/current/BP-1939426412-136.243.18.41-1690577621927] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:54:21,812 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/dfs/data/data4/current/BP-1939426412-136.243.18.41-1690577621927] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:54:21,815 WARN [Listener at localhost.localdomain/43311] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-28 20:54:21,824 INFO [Listener at localhost.localdomain/43311] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-28 20:54:21,930 WARN [BP-1939426412-136.243.18.41-1690577621927 heartbeating to localhost.localdomain/127.0.0.1:44723] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-28 20:54:21,930 WARN [BP-1939426412-136.243.18.41-1690577621927 heartbeating to localhost.localdomain/127.0.0.1:44723] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1939426412-136.243.18.41-1690577621927 (Datanode Uuid add8f56a-bdba-4c8c-97d9-07ed84915ff2) service to localhost.localdomain/127.0.0.1:44723 2023-07-28 20:54:21,931 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/dfs/data/data9/current/BP-1939426412-136.243.18.41-1690577621927] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:54:21,931 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/dfs/data/data10/current/BP-1939426412-136.243.18.41-1690577621927] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:54:21,934 WARN [Listener at localhost.localdomain/43311] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-28 20:54:21,966 INFO [Listener at localhost.localdomain/43311] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-28 20:54:21,970 WARN [78142765@qtp-2043389929-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34949] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-28 20:54:21,970 WARN [78142765@qtp-2043389929-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34949] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-28 20:54:22,069 WARN [BP-1939426412-136.243.18.41-1690577621927 heartbeating to localhost.localdomain/127.0.0.1:44723] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-28 20:54:22,069 WARN [BP-1939426412-136.243.18.41-1690577621927 heartbeating to localhost.localdomain/127.0.0.1:44723] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1939426412-136.243.18.41-1690577621927 (Datanode Uuid aba7fb1b-da52-46af-b380-e80b2af21dd9) service to localhost.localdomain/127.0.0.1:44723 2023-07-28 20:54:22,070 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/dfs/data/data7/current/BP-1939426412-136.243.18.41-1690577621927] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:54:22,071 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/dfs/data/data8/current/BP-1939426412-136.243.18.41-1690577621927] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:54:22,073 WARN [Listener at localhost.localdomain/43311] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-28 20:54:22,102 INFO [Listener at localhost.localdomain/43311] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-28 20:54:22,204 WARN [BP-1939426412-136.243.18.41-1690577621927 heartbeating to localhost.localdomain/127.0.0.1:44723] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-28 20:54:22,204 WARN [BP-1939426412-136.243.18.41-1690577621927 heartbeating to localhost.localdomain/127.0.0.1:44723] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1939426412-136.243.18.41-1690577621927 (Datanode Uuid f8cb4407-3a70-437d-b636-9ca609993f42) service to localhost.localdomain/127.0.0.1:44723 2023-07-28 20:54:22,206 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/dfs/data/data5/current/BP-1939426412-136.243.18.41-1690577621927] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:54:22,206 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/dfs/data/data6/current/BP-1939426412-136.243.18.41-1690577621927] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:54:22,208 WARN [Listener at localhost.localdomain/43311] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-28 20:54:22,248 INFO [Listener at localhost.localdomain/43311] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-28 20:54:22,252 WARN [2126459565@qtp-951539878-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45429] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-28 20:54:22,253 WARN [2126459565@qtp-951539878-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45429] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-28 20:54:22,277 WARN [BP-1939426412-136.243.18.41-1690577621927 heartbeating to localhost.localdomain/127.0.0.1:44723] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-28 20:54:22,277 WARN [BP-1939426412-136.243.18.41-1690577621927 heartbeating to localhost.localdomain/127.0.0.1:44723] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1939426412-136.243.18.41-1690577621927 (Datanode Uuid ab2b275a-74ca-41ed-8b9b-522f16edc94c) service to localhost.localdomain/127.0.0.1:44723 2023-07-28 20:54:22,278 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/dfs/data/data1/current/BP-1939426412-136.243.18.41-1690577621927] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:54:22,278 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/cluster_af6364e1-4ea3-0ab6-b07d-43aecc0a9fca/dfs/data/data2/current/BP-1939426412-136.243.18.41-1690577621927] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:54:22,335 INFO [Listener at localhost.localdomain/43311] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-28 20:54:22,336 WARN [745201858@qtp-488489211-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:45897] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-28 20:54:22,336 WARN [745201858@qtp-488489211-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:45897] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-28 20:54:22,458 INFO [Listener at localhost.localdomain/43311] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-28 20:54:22,525 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-28 20:54:22,539 INFO [Listener at localhost.localdomain/43311] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnDatanodeDeath Thread=77 (was 10) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (700961387) connection to localhost.localdomain/127.0.0.1:44723 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:44723 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: regionserver/jenkins-hbase17:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost.localdomain:44723 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase17:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/43311 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (700961387) connection to localhost.localdomain/127.0.0.1:44723 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: master/jenkins-hbase17:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (700961387) connection to localhost.localdomain/127.0.0.1:44723 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@3a63c81d java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=467 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1568 (was 1470) - SystemLoadAverage LEAK? -, ProcessCount=193 (was 194), AvailableMemoryMB=1987 (was 314) - AvailableMemoryMB LEAK? - 2023-07-28 20:54:22,551 INFO [Listener at localhost.localdomain/43311] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=77, OpenFileDescriptor=467, MaxFileDescriptor=60000, SystemLoadAverage=1568, ProcessCount=193, AvailableMemoryMB=1985 2023-07-28 20:54:22,552 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-28 20:54:22,552 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/hadoop.log.dir so I do NOT create it in target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98 2023-07-28 20:54:22,552 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1eb7b4dc-0dd5-8e0a-8dcc-da1bd92aa44e/hadoop.tmp.dir so I do NOT create it in target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98 2023-07-28 20:54:22,552 INFO [Listener at localhost.localdomain/43311] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/cluster_f72de4d3-eff8-9b80-f119-4c7895f6fbbc, deleteOnExit=true 2023-07-28 20:54:22,552 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-28 20:54:22,552 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/test.cache.data in system properties and HBase conf 2023-07-28 20:54:22,552 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/hadoop.tmp.dir in system properties and HBase conf 2023-07-28 20:54:22,552 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/hadoop.log.dir in system properties and HBase conf 2023-07-28 20:54:22,553 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-28 20:54:22,553 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-28 20:54:22,553 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-28 20:54:22,553 DEBUG [Listener at localhost.localdomain/43311] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-28 20:54:22,553 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-28 20:54:22,553 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-28 20:54:22,553 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-28 20:54:22,553 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-28 20:54:22,554 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-28 20:54:22,554 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-28 20:54:22,554 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-28 20:54:22,554 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-28 20:54:22,554 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-28 20:54:22,554 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/nfs.dump.dir in system properties and HBase conf 2023-07-28 20:54:22,554 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/java.io.tmpdir in system properties and HBase conf 2023-07-28 20:54:22,554 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-28 20:54:22,554 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-28 20:54:22,554 INFO [Listener at localhost.localdomain/43311] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-28 20:54:22,559 WARN [Listener at localhost.localdomain/43311] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-28 20:54:22,559 WARN [Listener at localhost.localdomain/43311] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-28 20:54:22,596 WARN [Listener at localhost.localdomain/43311] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:54:22,598 INFO [Listener at localhost.localdomain/43311] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:54:22,603 INFO [Listener at localhost.localdomain/43311] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/java.io.tmpdir/Jetty_localhost_localdomain_39881_hdfs____.abnndn/webapp 2023-07-28 20:54:22,686 INFO [Listener at localhost.localdomain/43311] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:39881 2023-07-28 20:54:22,691 WARN [Listener at localhost.localdomain/43311] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-28 20:54:22,692 WARN [Listener at localhost.localdomain/43311] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-28 20:54:22,757 WARN [Listener at localhost.localdomain/37811] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:54:22,782 WARN [Listener at localhost.localdomain/37811] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-28 20:54:22,785 WARN [Listener at localhost.localdomain/37811] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:54:22,787 INFO [Listener at localhost.localdomain/37811] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:54:22,795 INFO [Listener at localhost.localdomain/37811] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/java.io.tmpdir/Jetty_localhost_36993_datanode____3nfg6v/webapp 2023-07-28 20:54:22,881 INFO [Listener at localhost.localdomain/37811] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36993 2023-07-28 20:54:22,894 WARN [Listener at localhost.localdomain/38349] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:54:22,934 WARN [Listener at localhost.localdomain/38349] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-28 20:54:22,937 WARN [Listener at localhost.localdomain/38349] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:54:22,939 INFO [Listener at localhost.localdomain/38349] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:54:22,945 INFO [Listener at localhost.localdomain/38349] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/java.io.tmpdir/Jetty_localhost_46199_datanode____ajxbxy/webapp 2023-07-28 20:54:23,024 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe73db4d9249ad09: Processing first storage report for DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff from datanode 5ef16cfe-1511-4e8b-b0a4-116a6821c13f 2023-07-28 20:54:23,025 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe73db4d9249ad09: from storage DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff node DatanodeRegistration(127.0.0.1:41913, datanodeUuid=5ef16cfe-1511-4e8b-b0a4-116a6821c13f, infoPort=37075, infoSecurePort=0, ipcPort=38349, storageInfo=lv=-57;cid=testClusterID;nsid=2031156227;c=1690577662562), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-28 20:54:23,025 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe73db4d9249ad09: Processing first storage report for DS-019c948d-dfc9-44c6-8eda-d997d625b553 from datanode 5ef16cfe-1511-4e8b-b0a4-116a6821c13f 2023-07-28 20:54:23,025 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe73db4d9249ad09: from storage DS-019c948d-dfc9-44c6-8eda-d997d625b553 node DatanodeRegistration(127.0.0.1:41913, datanodeUuid=5ef16cfe-1511-4e8b-b0a4-116a6821c13f, infoPort=37075, infoSecurePort=0, ipcPort=38349, storageInfo=lv=-57;cid=testClusterID;nsid=2031156227;c=1690577662562), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:54:23,064 INFO [Listener at localhost.localdomain/38349] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46199 2023-07-28 20:54:23,084 WARN [Listener at localhost.localdomain/38345] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:54:23,235 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc1d736812f0b7cc: Processing first storage report for DS-28d70e4f-a9c1-44da-8fc8-454b7255d720 from datanode 7050bdfc-1637-4809-a168-10ac9bc95bfe 2023-07-28 20:54:23,235 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc1d736812f0b7cc: from storage DS-28d70e4f-a9c1-44da-8fc8-454b7255d720 node DatanodeRegistration(127.0.0.1:33323, datanodeUuid=7050bdfc-1637-4809-a168-10ac9bc95bfe, infoPort=42831, infoSecurePort=0, ipcPort=38345, storageInfo=lv=-57;cid=testClusterID;nsid=2031156227;c=1690577662562), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:54:23,235 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc1d736812f0b7cc: Processing first storage report for DS-d96c1fca-6f44-4114-9fb3-48ad39eba6ba from datanode 7050bdfc-1637-4809-a168-10ac9bc95bfe 2023-07-28 20:54:23,235 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc1d736812f0b7cc: from storage DS-d96c1fca-6f44-4114-9fb3-48ad39eba6ba node DatanodeRegistration(127.0.0.1:33323, datanodeUuid=7050bdfc-1637-4809-a168-10ac9bc95bfe, infoPort=42831, infoSecurePort=0, ipcPort=38345, storageInfo=lv=-57;cid=testClusterID;nsid=2031156227;c=1690577662562), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:54:23,252 DEBUG [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98 2023-07-28 20:54:23,272 INFO [Listener at localhost.localdomain/38345] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/cluster_f72de4d3-eff8-9b80-f119-4c7895f6fbbc/zookeeper_0, clientPort=63555, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/cluster_f72de4d3-eff8-9b80-f119-4c7895f6fbbc/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/cluster_f72de4d3-eff8-9b80-f119-4c7895f6fbbc/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-28 20:54:23,274 INFO [Listener at localhost.localdomain/38345] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63555 2023-07-28 20:54:23,274 INFO [Listener at localhost.localdomain/38345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:54:23,276 INFO [Listener at localhost.localdomain/38345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:54:23,321 INFO [Listener at localhost.localdomain/38345] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659 with version=8 2023-07-28 20:54:23,322 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/hbase-staging 2023-07-28 20:54:23,324 INFO [Listener at localhost.localdomain/38345] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-28 20:54:23,324 INFO [Listener at localhost.localdomain/38345] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:54:23,324 INFO [Listener at localhost.localdomain/38345] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-28 20:54:23,324 INFO [Listener at localhost.localdomain/38345] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-28 20:54:23,325 INFO [Listener at localhost.localdomain/38345] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:54:23,325 INFO [Listener at localhost.localdomain/38345] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-28 20:54:23,325 INFO [Listener at localhost.localdomain/38345] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-28 20:54:23,328 INFO [Listener at localhost.localdomain/38345] ipc.NettyRpcServer(120): Bind to /136.243.18.41:38161 2023-07-28 20:54:23,328 INFO [Listener at localhost.localdomain/38345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:54:23,331 INFO [Listener at localhost.localdomain/38345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:54:23,333 INFO [Listener at localhost.localdomain/38345] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38161 connecting to ZooKeeper ensemble=127.0.0.1:63555 2023-07-28 20:54:23,359 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:381610x0, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-28 20:54:23,369 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38161-0x101adb570400000 connected 2023-07-28 20:54:23,424 DEBUG [Listener at localhost.localdomain/38345] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-28 20:54:23,425 DEBUG [Listener at localhost.localdomain/38345] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:54:23,426 DEBUG [Listener at localhost.localdomain/38345] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-28 20:54:23,427 DEBUG [Listener at localhost.localdomain/38345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38161 2023-07-28 20:54:23,428 DEBUG [Listener at localhost.localdomain/38345] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38161 2023-07-28 20:54:23,428 DEBUG [Listener at localhost.localdomain/38345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38161 2023-07-28 20:54:23,428 DEBUG [Listener at localhost.localdomain/38345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38161 2023-07-28 20:54:23,432 DEBUG [Listener at localhost.localdomain/38345] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38161 2023-07-28 20:54:23,432 INFO [Listener at localhost.localdomain/38345] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659, hbase.cluster.distributed=false 2023-07-28 20:54:23,449 INFO [Listener at localhost.localdomain/38345] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-28 20:54:23,449 INFO [Listener at localhost.localdomain/38345] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:54:23,449 INFO [Listener at localhost.localdomain/38345] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-28 20:54:23,450 INFO [Listener at localhost.localdomain/38345] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-28 20:54:23,450 INFO [Listener at localhost.localdomain/38345] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:54:23,450 INFO [Listener at localhost.localdomain/38345] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-28 20:54:23,450 INFO [Listener at localhost.localdomain/38345] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-28 20:54:23,458 INFO [Listener at localhost.localdomain/38345] ipc.NettyRpcServer(120): Bind to /136.243.18.41:43845 2023-07-28 20:54:23,459 INFO [Listener at localhost.localdomain/38345] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-28 20:54:23,475 DEBUG [Listener at localhost.localdomain/38345] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-28 20:54:23,477 INFO [Listener at localhost.localdomain/38345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:54:23,479 INFO [Listener at localhost.localdomain/38345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:54:23,481 INFO [Listener at localhost.localdomain/38345] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43845 connecting to ZooKeeper ensemble=127.0.0.1:63555 2023-07-28 20:54:23,486 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:438450x0, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-28 20:54:23,487 DEBUG [Listener at localhost.localdomain/38345] zookeeper.ZKUtil(164): regionserver:438450x0, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-28 20:54:23,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43845-0x101adb570400001 connected 2023-07-28 20:54:23,499 DEBUG [Listener at localhost.localdomain/38345] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:54:23,516 DEBUG [Listener at localhost.localdomain/38345] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-28 20:54:23,526 DEBUG [Listener at localhost.localdomain/38345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43845 2023-07-28 20:54:23,528 DEBUG [Listener at localhost.localdomain/38345] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43845 2023-07-28 20:54:23,532 DEBUG [Listener at localhost.localdomain/38345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43845 2023-07-28 20:54:23,537 DEBUG [Listener at localhost.localdomain/38345] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43845 2023-07-28 20:54:23,540 DEBUG [Listener at localhost.localdomain/38345] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43845 2023-07-28 20:54:23,543 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,38161,1690577663323 2023-07-28 20:54:23,552 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-28 20:54:23,554 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,38161,1690577663323 2023-07-28 20:54:23,560 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-28 20:54:23,561 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-28 20:54:23,561 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:54:23,568 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-28 20:54:23,577 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,38161,1690577663323 from backup master directory 2023-07-28 20:54:23,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-28 20:54:23,593 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,38161,1690577663323 2023-07-28 20:54:23,593 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-28 20:54:23,593 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-28 20:54:23,594 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,38161,1690577663323 2023-07-28 20:54:23,653 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/hbase.id with ID: 9c86f0b3-edf3-43a7-b319-7ba6912f9a6e 2023-07-28 20:54:23,689 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:54:23,692 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:54:23,731 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x36f68b7f to 127.0.0.1:63555 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-28 20:54:23,742 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e8dc330, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-28 20:54:23,742 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-28 20:54:23,743 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-28 20:54:23,743 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:54:23,746 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/data/master/store-tmp 2023-07-28 20:54:24,190 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:54:24,190 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-28 20:54:24,190 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:54:24,190 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:54:24,190 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-28 20:54:24,191 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:54:24,191 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:54:24,191 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-28 20:54:24,192 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/WALs/jenkins-hbase17.apache.org,38161,1690577663323 2023-07-28 20:54:24,200 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C38161%2C1690577663323, suffix=, logDir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/WALs/jenkins-hbase17.apache.org,38161,1690577663323, archiveDir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/oldWALs, maxLogs=10 2023-07-28 20:54:24,248 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41913,DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff,DISK] 2023-07-28 20:54:24,266 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33323,DS-28d70e4f-a9c1-44da-8fc8-454b7255d720,DISK] 2023-07-28 20:54:24,277 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/WALs/jenkins-hbase17.apache.org,38161,1690577663323/jenkins-hbase17.apache.org%2C38161%2C1690577663323.1690577664200 2023-07-28 20:54:24,281 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41913,DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff,DISK], DatanodeInfoWithStorage[127.0.0.1:33323,DS-28d70e4f-a9c1-44da-8fc8-454b7255d720,DISK]] 2023-07-28 20:54:24,282 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:54:24,282 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:54:24,282 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:54:24,282 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:54:24,287 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:54:24,298 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-28 20:54:24,299 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-28 20:54:24,304 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:54:24,311 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:54:24,324 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:54:24,343 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:54:24,347 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:54:24,349 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=757432, jitterRate=-0.03687611222267151}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:54:24,349 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-28 20:54:24,349 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-28 20:54:24,354 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-28 20:54:24,354 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-28 20:54:24,354 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-28 20:54:24,355 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-28 20:54:24,356 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-28 20:54:24,356 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-28 20:54:24,357 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-28 20:54:24,359 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-28 20:54:24,375 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-28 20:54:24,375 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-28 20:54:24,376 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-28 20:54:24,376 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-28 20:54:24,377 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-28 20:54:24,381 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:54:24,386 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-28 20:54:24,387 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-28 20:54:24,389 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-28 20:54:24,390 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-28 20:54:24,390 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:54:24,390 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-28 20:54:24,390 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,38161,1690577663323, sessionid=0x101adb570400000, setting cluster-up flag (Was=false) 2023-07-28 20:54:24,394 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:54:24,400 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-28 20:54:24,404 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,38161,1690577663323 2023-07-28 20:54:24,411 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:54:24,416 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-28 20:54:24,418 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,38161,1690577663323 2023-07-28 20:54:24,421 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/.hbase-snapshot/.tmp 2023-07-28 20:54:24,431 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-28 20:54:24,432 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:54:24,432 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:54:24,432 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:54:24,432 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:54:24,433 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-28 20:54:24,433 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:54:24,433 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-28 20:54:24,433 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:54:24,438 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690577694438 2023-07-28 20:54:24,438 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-28 20:54:24,439 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-28 20:54:24,439 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-28 20:54:24,439 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-28 20:54:24,439 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-28 20:54:24,439 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-28 20:54:24,440 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:24,441 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-28 20:54:24,441 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-28 20:54:24,441 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-28 20:54:24,441 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-28 20:54:24,441 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-28 20:54:24,444 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-28 20:54:24,444 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-28 20:54:24,444 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690577664444,5,FailOnTimeoutGroup] 2023-07-28 20:54:24,445 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690577664444,5,FailOnTimeoutGroup] 2023-07-28 20:54:24,445 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:24,445 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-28 20:54:24,445 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:24,445 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:24,445 INFO [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(951): ClusterId : 9c86f0b3-edf3-43a7-b319-7ba6912f9a6e 2023-07-28 20:54:24,447 DEBUG [RS:0;jenkins-hbase17:43845] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-28 20:54:24,448 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-28 20:54:24,455 DEBUG [RS:0;jenkins-hbase17:43845] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-28 20:54:24,455 DEBUG [RS:0;jenkins-hbase17:43845] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-28 20:54:24,468 DEBUG [RS:0;jenkins-hbase17:43845] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-28 20:54:24,470 DEBUG [RS:0;jenkins-hbase17:43845] zookeeper.ReadOnlyZKClient(139): Connect 0x023b05e3 to 127.0.0.1:63555 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-28 20:54:24,487 DEBUG [RS:0;jenkins-hbase17:43845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cfcfbd4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-28 20:54:24,487 DEBUG [RS:0;jenkins-hbase17:43845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8c36e93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-28 20:54:24,500 DEBUG [RS:0;jenkins-hbase17:43845] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:43845 2023-07-28 20:54:24,500 INFO [RS:0;jenkins-hbase17:43845] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-28 20:54:24,500 INFO [RS:0;jenkins-hbase17:43845] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-28 20:54:24,500 DEBUG [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1022): About to register with Master. 2023-07-28 20:54:24,501 INFO [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,38161,1690577663323 with isa=jenkins-hbase17.apache.org/136.243.18.41:43845, startcode=1690577663448 2023-07-28 20:54:24,501 DEBUG [RS:0;jenkins-hbase17:43845] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-28 20:54:24,511 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-28 20:54:24,512 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42663, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-28 20:54:24,513 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-28 20:54:24,513 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659 2023-07-28 20:54:24,516 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38161] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:24,518 DEBUG [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659 2023-07-28 20:54:24,526 DEBUG [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37811 2023-07-28 20:54:24,526 DEBUG [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-28 20:54:24,532 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-28 20:54:24,557 DEBUG [RS:0;jenkins-hbase17:43845] zookeeper.ZKUtil(162): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:24,557 WARN [RS:0;jenkins-hbase17:43845] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-28 20:54:24,557 INFO [RS:0;jenkins-hbase17:43845] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:54:24,557 DEBUG [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:24,558 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,43845,1690577663448] 2023-07-28 20:54:24,586 DEBUG [RS:0;jenkins-hbase17:43845] zookeeper.ZKUtil(162): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:24,588 DEBUG [RS:0;jenkins-hbase17:43845] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-28 20:54:24,589 INFO [RS:0;jenkins-hbase17:43845] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-28 20:54:24,660 INFO [RS:0;jenkins-hbase17:43845] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-28 20:54:24,661 INFO [RS:0;jenkins-hbase17:43845] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-28 20:54:24,661 INFO [RS:0;jenkins-hbase17:43845] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:24,662 INFO [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-28 20:54:24,663 INFO [RS:0;jenkins-hbase17:43845] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:24,664 DEBUG [RS:0;jenkins-hbase17:43845] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:54:24,664 DEBUG [RS:0;jenkins-hbase17:43845] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:54:24,664 DEBUG [RS:0;jenkins-hbase17:43845] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:54:24,664 DEBUG [RS:0;jenkins-hbase17:43845] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:54:24,664 DEBUG [RS:0;jenkins-hbase17:43845] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:54:24,664 DEBUG [RS:0;jenkins-hbase17:43845] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-28 20:54:24,665 DEBUG [RS:0;jenkins-hbase17:43845] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:54:24,665 DEBUG [RS:0;jenkins-hbase17:43845] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:54:24,665 DEBUG [RS:0;jenkins-hbase17:43845] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:54:24,665 DEBUG [RS:0;jenkins-hbase17:43845] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:54:24,676 INFO [RS:0;jenkins-hbase17:43845] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:24,677 INFO [RS:0;jenkins-hbase17:43845] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:24,677 INFO [RS:0;jenkins-hbase17:43845] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:24,698 INFO [RS:0;jenkins-hbase17:43845] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-28 20:54:24,698 INFO [RS:0;jenkins-hbase17:43845] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43845,1690577663448-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:24,716 INFO [RS:0;jenkins-hbase17:43845] regionserver.Replication(203): jenkins-hbase17.apache.org,43845,1690577663448 started 2023-07-28 20:54:24,716 INFO [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,43845,1690577663448, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:43845, sessionid=0x101adb570400001 2023-07-28 20:54:24,716 DEBUG [RS:0;jenkins-hbase17:43845] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-28 20:54:24,717 DEBUG [RS:0;jenkins-hbase17:43845] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:24,717 DEBUG [RS:0;jenkins-hbase17:43845] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,43845,1690577663448' 2023-07-28 20:54:24,717 DEBUG [RS:0;jenkins-hbase17:43845] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:54:24,727 DEBUG [RS:0;jenkins-hbase17:43845] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:54:24,728 DEBUG [RS:0;jenkins-hbase17:43845] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-28 20:54:24,728 DEBUG [RS:0;jenkins-hbase17:43845] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-28 20:54:24,728 DEBUG [RS:0;jenkins-hbase17:43845] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:24,728 DEBUG [RS:0;jenkins-hbase17:43845] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,43845,1690577663448' 2023-07-28 20:54:24,728 DEBUG [RS:0;jenkins-hbase17:43845] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-28 20:54:24,729 DEBUG [RS:0;jenkins-hbase17:43845] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-28 20:54:24,730 DEBUG [RS:0;jenkins-hbase17:43845] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-28 20:54:24,730 INFO [RS:0;jenkins-hbase17:43845] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-28 20:54:24,730 INFO [RS:0;jenkins-hbase17:43845] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-28 20:54:24,837 INFO [RS:0;jenkins-hbase17:43845] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C43845%2C1690577663448, suffix=, logDir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448, archiveDir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/oldWALs, maxLogs=32 2023-07-28 20:54:24,884 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33323,DS-28d70e4f-a9c1-44da-8fc8-454b7255d720,DISK] 2023-07-28 20:54:24,890 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41913,DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff,DISK] 2023-07-28 20:54:24,904 INFO [RS:0;jenkins-hbase17:43845] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577664840 2023-07-28 20:54:24,905 DEBUG [RS:0;jenkins-hbase17:43845] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41913,DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff,DISK], DatanodeInfoWithStorage[127.0.0.1:33323,DS-28d70e4f-a9c1-44da-8fc8-454b7255d720,DISK]] 2023-07-28 20:54:25,071 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:54:25,073 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-28 20:54:25,076 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/info 2023-07-28 20:54:25,077 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-28 20:54:25,079 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:54:25,079 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-28 20:54:25,082 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/rep_barrier 2023-07-28 20:54:25,083 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-28 20:54:25,084 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:54:25,084 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-28 20:54:25,086 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/table 2023-07-28 20:54:25,087 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-28 20:54:25,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:54:25,089 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740 2023-07-28 20:54:25,090 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740 2023-07-28 20:54:25,094 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-28 20:54:25,096 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-28 20:54:25,100 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:54:25,101 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=695510, jitterRate=-0.11561396718025208}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-28 20:54:25,101 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-28 20:54:25,101 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-28 20:54:25,102 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-28 20:54:25,102 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-28 20:54:25,102 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-28 20:54:25,102 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-28 20:54:25,102 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-28 20:54:25,102 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-28 20:54:25,104 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-28 20:54:25,104 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-28 20:54:25,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-28 20:54:25,107 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-28 20:54:25,110 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-28 20:54:25,261 DEBUG [jenkins-hbase17:38161] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-28 20:54:25,261 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,43845,1690577663448, state=OPENING 2023-07-28 20:54:25,263 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-28 20:54:25,264 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:54:25,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,43845,1690577663448}] 2023-07-28 20:54:25,264 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-28 20:54:25,419 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:25,419 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-28 20:54:25,422 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-28 20:54:25,427 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-28 20:54:25,427 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:54:25,429 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C43845%2C1690577663448.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448, archiveDir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/oldWALs, maxLogs=32 2023-07-28 20:54:25,458 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33323,DS-28d70e4f-a9c1-44da-8fc8-454b7255d720,DISK] 2023-07-28 20:54:25,460 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41913,DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff,DISK] 2023-07-28 20:54:25,466 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.meta.1690577665432.meta 2023-07-28 20:54:25,466 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33323,DS-28d70e4f-a9c1-44da-8fc8-454b7255d720,DISK], DatanodeInfoWithStorage[127.0.0.1:41913,DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff,DISK]] 2023-07-28 20:54:25,466 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:54:25,466 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-28 20:54:25,467 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-28 20:54:25,468 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-28 20:54:25,468 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-28 20:54:25,468 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:54:25,468 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-28 20:54:25,468 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-28 20:54:25,472 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-28 20:54:25,474 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/info 2023-07-28 20:54:25,474 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/info 2023-07-28 20:54:25,475 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-28 20:54:25,476 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:54:25,476 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-28 20:54:25,478 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/rep_barrier 2023-07-28 20:54:25,478 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/rep_barrier 2023-07-28 20:54:25,479 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-28 20:54:25,480 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:54:25,480 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-28 20:54:25,482 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/table 2023-07-28 20:54:25,482 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/table 2023-07-28 20:54:25,483 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-28 20:54:25,485 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:54:25,486 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740 2023-07-28 20:54:25,488 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740 2023-07-28 20:54:25,491 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-28 20:54:25,498 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-28 20:54:25,499 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=696852, jitterRate=-0.11390700936317444}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-28 20:54:25,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-28 20:54:25,500 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690577665419 2023-07-28 20:54:25,504 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-28 20:54:25,505 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-28 20:54:25,506 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,43845,1690577663448, state=OPEN 2023-07-28 20:54:25,507 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-28 20:54:25,507 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-28 20:54:25,515 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-28 20:54:25,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,43845,1690577663448 in 247 msec 2023-07-28 20:54:25,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-28 20:54:25,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 412 msec 2023-07-28 20:54:25,533 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0940 sec 2023-07-28 20:54:25,533 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690577665533, completionTime=-1 2023-07-28 20:54:25,533 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-28 20:54:25,533 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-28 20:54:25,540 DEBUG [hconnection-0x7da5c9c2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-28 20:54:25,544 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-28 20:54:25,547 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-28 20:54:25,547 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690577725547 2023-07-28 20:54:25,547 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690577785547 2023-07-28 20:54:25,547 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 13 msec 2023-07-28 20:54:25,561 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38161,1690577663323-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:25,561 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38161,1690577663323-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:25,562 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38161,1690577663323-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:25,562 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:38161, period=300000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:25,562 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-28 20:54:25,562 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-28 20:54:25,562 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-28 20:54:25,565 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-28 20:54:25,565 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-28 20:54:25,568 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-28 20:54:25,573 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-28 20:54:25,579 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/.tmp/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d 2023-07-28 20:54:25,582 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/.tmp/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d empty. 2023-07-28 20:54:25,586 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/.tmp/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d 2023-07-28 20:54:25,586 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-28 20:54:25,623 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-28 20:54:25,633 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 19031a0ee73e7f79f5d1465cab22919d, NAME => 'hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/.tmp 2023-07-28 20:54:26,085 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:54:26,085 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 19031a0ee73e7f79f5d1465cab22919d, disabling compactions & flushes 2023-07-28 20:54:26,085 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:54:26,085 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:54:26,085 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. after waiting 0 ms 2023-07-28 20:54:26,085 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:54:26,085 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:54:26,085 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 19031a0ee73e7f79f5d1465cab22919d: 2023-07-28 20:54:26,090 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-28 20:54:26,092 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690577666091"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690577666091"}]},"ts":"1690577666091"} 2023-07-28 20:54:26,100 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-28 20:54:26,103 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-28 20:54:26,103 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577666103"}]},"ts":"1690577666103"} 2023-07-28 20:54:26,108 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-28 20:54:26,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=19031a0ee73e7f79f5d1465cab22919d, ASSIGN}] 2023-07-28 20:54:26,117 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=19031a0ee73e7f79f5d1465cab22919d, ASSIGN 2023-07-28 20:54:26,119 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=19031a0ee73e7f79f5d1465cab22919d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,43845,1690577663448; forceNewPlan=false, retain=false 2023-07-28 20:54:26,270 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=19031a0ee73e7f79f5d1465cab22919d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:26,271 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690577666270"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690577666270"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690577666270"}]},"ts":"1690577666270"} 2023-07-28 20:54:26,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 19031a0ee73e7f79f5d1465cab22919d, server=jenkins-hbase17.apache.org,43845,1690577663448}] 2023-07-28 20:54:26,429 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:54:26,430 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19031a0ee73e7f79f5d1465cab22919d, NAME => 'hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d.', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:54:26,430 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 19031a0ee73e7f79f5d1465cab22919d 2023-07-28 20:54:26,430 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:54:26,430 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 19031a0ee73e7f79f5d1465cab22919d 2023-07-28 20:54:26,430 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 19031a0ee73e7f79f5d1465cab22919d 2023-07-28 20:54:26,432 INFO [StoreOpener-19031a0ee73e7f79f5d1465cab22919d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 19031a0ee73e7f79f5d1465cab22919d 2023-07-28 20:54:26,434 DEBUG [StoreOpener-19031a0ee73e7f79f5d1465cab22919d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d/info 2023-07-28 20:54:26,435 DEBUG [StoreOpener-19031a0ee73e7f79f5d1465cab22919d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d/info 2023-07-28 20:54:26,435 INFO [StoreOpener-19031a0ee73e7f79f5d1465cab22919d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19031a0ee73e7f79f5d1465cab22919d columnFamilyName info 2023-07-28 20:54:26,436 INFO [StoreOpener-19031a0ee73e7f79f5d1465cab22919d-1] regionserver.HStore(310): Store=19031a0ee73e7f79f5d1465cab22919d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:54:26,437 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d 2023-07-28 20:54:26,438 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d 2023-07-28 20:54:26,441 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 19031a0ee73e7f79f5d1465cab22919d 2023-07-28 20:54:26,444 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:54:26,445 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 19031a0ee73e7f79f5d1465cab22919d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=849119, jitterRate=0.07971134781837463}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:54:26,445 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 19031a0ee73e7f79f5d1465cab22919d: 2023-07-28 20:54:26,446 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d., pid=6, masterSystemTime=1690577666426 2023-07-28 20:54:26,449 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:54:26,449 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:54:26,450 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=19031a0ee73e7f79f5d1465cab22919d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:26,451 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690577666450"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690577666450"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690577666450"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690577666450"}]},"ts":"1690577666450"} 2023-07-28 20:54:26,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-28 20:54:26,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 19031a0ee73e7f79f5d1465cab22919d, server=jenkins-hbase17.apache.org,43845,1690577663448 in 180 msec 2023-07-28 20:54:26,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-28 20:54:26,461 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=19031a0ee73e7f79f5d1465cab22919d, ASSIGN in 342 msec 2023-07-28 20:54:26,462 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-28 20:54:26,462 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577666462"}]},"ts":"1690577666462"} 2023-07-28 20:54:26,464 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-28 20:54:26,467 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-28 20:54:26,468 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-28 20:54:26,469 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-28 20:54:26,469 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:54:26,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 906 msec 2023-07-28 20:54:26,474 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-28 20:54:26,485 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-28 20:54:26,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 15 msec 2023-07-28 20:54:26,497 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-28 20:54:26,512 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-28 20:54:26,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2023-07-28 20:54:26,535 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-28 20:54:26,537 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-28 20:54:26,538 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.944sec 2023-07-28 20:54:26,538 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-28 20:54:26,538 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-28 20:54:26,538 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-28 20:54:26,538 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38161,1690577663323-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-28 20:54:26,538 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38161,1690577663323-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-28 20:54:26,540 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-28 20:54:26,562 DEBUG [Listener at localhost.localdomain/38345] zookeeper.ReadOnlyZKClient(139): Connect 0x0ed0040d to 127.0.0.1:63555 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-28 20:54:26,569 DEBUG [Listener at localhost.localdomain/38345] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79e603a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-28 20:54:26,571 DEBUG [hconnection-0x2c23c5be-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-28 20:54:26,573 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-28 20:54:26,578 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,38161,1690577663323 2023-07-28 20:54:26,578 INFO [Listener at localhost.localdomain/38345] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:54:26,582 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-28 20:54:26,582 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:54:26,583 INFO [Listener at localhost.localdomain/38345] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-28 20:54:26,585 DEBUG [Listener at localhost.localdomain/38345] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-28 20:54:26,593 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-28 20:54:26,595 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-07-28 20:54:26,596 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-07-28 20:54:26,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-28 20:54:26,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:26,602 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-07-28 20:54:26,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testCompactionRecordDoesntBlockRolling" procId is: 9 2023-07-28 20:54:26,603 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-28 20:54:26,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-28 20:54:26,610 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914 2023-07-28 20:54:26,612 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914 empty. 2023-07-28 20:54:26,613 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914 2023-07-28 20:54:26,613 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testCompactionRecordDoesntBlockRolling regions 2023-07-28 20:54:26,638 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/.tmp/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/.tabledesc/.tableinfo.0000000001 2023-07-28 20:54:26,644 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => b9a5f08d2375621602c912889a175914, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testCompactionRecordDoesntBlockRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/.tmp 2023-07-28 20:54:26,684 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:54:26,684 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1604): Closing b9a5f08d2375621602c912889a175914, disabling compactions & flushes 2023-07-28 20:54:26,684 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:54:26,684 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:54:26,684 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. after waiting 0 ms 2023-07-28 20:54:26,684 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:54:26,684 INFO [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:54:26,684 DEBUG [RegionOpenAndInit-TestLogRolling-testCompactionRecordDoesntBlockRolling-pool-0] regionserver.HRegion(1558): Region close journal for b9a5f08d2375621602c912889a175914: 2023-07-28 20:54:26,709 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ADD_TO_META 2023-07-28 20:54:26,713 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1690577666713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690577666713"}]},"ts":"1690577666713"} 2023-07-28 20:54:26,718 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-28 20:54:26,719 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-28 20:54:26,720 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577666720"}]},"ts":"1690577666720"} 2023-07-28 20:54:26,723 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLING in hbase:meta 2023-07-28 20:54:26,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=b9a5f08d2375621602c912889a175914, ASSIGN}] 2023-07-28 20:54:26,729 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=b9a5f08d2375621602c912889a175914, ASSIGN 2023-07-28 20:54:26,731 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=b9a5f08d2375621602c912889a175914, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,43845,1690577663448; forceNewPlan=false, retain=false 2023-07-28 20:54:26,883 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b9a5f08d2375621602c912889a175914, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:26,883 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1690577666882"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690577666882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690577666882"}]},"ts":"1690577666882"} 2023-07-28 20:54:26,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure b9a5f08d2375621602c912889a175914, server=jenkins-hbase17.apache.org,43845,1690577663448}] 2023-07-28 20:54:27,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:54:27,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b9a5f08d2375621602c912889a175914, NAME => 'TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:54:27,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testCompactionRecordDoesntBlockRolling b9a5f08d2375621602c912889a175914 2023-07-28 20:54:27,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:54:27,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b9a5f08d2375621602c912889a175914 2023-07-28 20:54:27,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b9a5f08d2375621602c912889a175914 2023-07-28 20:54:27,051 INFO [StoreOpener-b9a5f08d2375621602c912889a175914-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b9a5f08d2375621602c912889a175914 2023-07-28 20:54:27,053 DEBUG [StoreOpener-b9a5f08d2375621602c912889a175914-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info 2023-07-28 20:54:27,053 DEBUG [StoreOpener-b9a5f08d2375621602c912889a175914-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info 2023-07-28 20:54:27,054 INFO [StoreOpener-b9a5f08d2375621602c912889a175914-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9a5f08d2375621602c912889a175914 columnFamilyName info 2023-07-28 20:54:27,055 INFO [StoreOpener-b9a5f08d2375621602c912889a175914-1] regionserver.HStore(310): Store=b9a5f08d2375621602c912889a175914/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:54:27,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914 2023-07-28 20:54:27,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914 2023-07-28 20:54:27,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b9a5f08d2375621602c912889a175914 2023-07-28 20:54:27,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:54:27,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b9a5f08d2375621602c912889a175914; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=822192, jitterRate=0.04547148942947388}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:54:27,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b9a5f08d2375621602c912889a175914: 2023-07-28 20:54:27,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914., pid=11, masterSystemTime=1690577667040 2023-07-28 20:54:27,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:54:27,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:54:27,075 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b9a5f08d2375621602c912889a175914, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:27,075 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.","families":{"info":[{"qualifier":"regioninfo","vlen":87,"tag":[],"timestamp":"1690577667075"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690577667075"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690577667075"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690577667075"}]},"ts":"1690577667075"} 2023-07-28 20:54:27,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-28 20:54:27,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure b9a5f08d2375621602c912889a175914, server=jenkins-hbase17.apache.org,43845,1690577663448 in 194 msec 2023-07-28 20:54:27,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-28 20:54:27,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling, region=b9a5f08d2375621602c912889a175914, ASSIGN in 358 msec 2023-07-28 20:54:27,090 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-28 20:54:27,091 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testCompactionRecordDoesntBlockRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577667091"}]},"ts":"1690577667091"} 2023-07-28 20:54:27,093 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testCompactionRecordDoesntBlockRolling, state=ENABLED in hbase:meta 2023-07-28 20:54:27,096 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling execute state=CREATE_TABLE_POST_OPERATION 2023-07-28 20:54:27,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testCompactionRecordDoesntBlockRolling in 501 msec 2023-07-28 20:54:28,366 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-28 20:54:28,366 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-28 20:54:31,017 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-28 20:54:31,195 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-28 20:54:31,195 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-28 20:54:31,196 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-28 20:54:36,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-28 20:54:36,610 INFO [Listener at localhost.localdomain/38345] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testCompactionRecordDoesntBlockRolling, procId: 9 completed 2023-07-28 20:54:36,614 DEBUG [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:36,614 DEBUG [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:54:36,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-28 20:54:36,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] procedure.ProcedureCoordinator(165): Submitting procedure hbase:namespace 2023-07-28 20:54:36,635 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase:namespace' 2023-07-28 20:54:36,635 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-28 20:54:36,636 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase:namespace' starting 'acquire' 2023-07-28 20:54:36,636 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase:namespace', kicking off acquire phase on members. 2023-07-28 20:54:36,637 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-07-28 20:54:36,637 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-28 20:54:36,638 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-28 20:54:36,638 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-28 20:54:36,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:54:36,638 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,638 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-28 20:54:36,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase:namespace 2023-07-28 20:54:36,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase:namespace 2023-07-28 20:54:36,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-28 20:54:36,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-28 20:54:36,640 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase:namespace 2023-07-28 20:54:36,641 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase:namespace 2023-07-28 20:54:36,641 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase:namespace' with timeout 60000ms 2023-07-28 20:54:36,641 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-28 20:54:36,642 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase:namespace' starting 'acquire' stage 2023-07-28 20:54:36,642 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-28 20:54:36,642 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-28 20:54:36,642 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:54:36,642 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. started... 2023-07-28 20:54:36,643 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 19031a0ee73e7f79f5d1465cab22919d 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-28 20:54:36,657 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d/.tmp/info/dfce6babe232424197f3d663c35c435d 2023-07-28 20:54:36,669 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d/.tmp/info/dfce6babe232424197f3d663c35c435d as hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d/info/dfce6babe232424197f3d663c35c435d 2023-07-28 20:54:36,679 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d/info/dfce6babe232424197f3d663c35c435d, entries=2, sequenceid=6, filesize=4.8 K 2023-07-28 20:54:36,681 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 19031a0ee73e7f79f5d1465cab22919d in 38ms, sequenceid=6, compaction requested=false 2023-07-28 20:54:36,682 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 19031a0ee73e7f79f5d1465cab22919d: 2023-07-28 20:54:36,683 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:54:36,683 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-28 20:54:36,683 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-28 20:54:36,683 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,683 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase:namespace' locally acquired 2023-07-28 20:54:36,684 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43845,1690577663448' joining acquired barrier for procedure (hbase:namespace) in zk 2023-07-28 20:54:36,686 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,686 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-28 20:54:36,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:54:36,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:54:36,686 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace 2023-07-28 20:54:36,686 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase:namespace' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-28 20:54:36,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:54:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:54:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-28 20:54:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:54:36,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43845,1690577663448' joining acquired barrier for procedure 'hbase:namespace' on coordinator 2023-07-28 20:54:36,688 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase:namespace' starting 'in-barrier' execution. 2023-07-28 20:54:36,688 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-28 20:54:36,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45deded3[Count = 0] remaining members to acquire global barrier 2023-07-28 20:54:36,690 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-07-28 20:54:36,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-28 20:54:36,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase:namespace 2023-07-28 20:54:36,691 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase:namespace' received 'reached' from coordinator. 2023-07-28 20:54:36,691 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase:namespace' locally completed 2023-07-28 20:54:36,691 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase:namespace' completed for member 'jenkins-hbase17.apache.org,43845,1690577663448' in zk 2023-07-28 20:54:36,697 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,697 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-28 20:54:36,698 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,698 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase:namespace' has notified controller of completion 2023-07-28 20:54:36,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:54:36,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:54:36,698 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-28 20:54:36,698 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase:namespace' completed. 2023-07-28 20:54:36,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:54:36,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:54:36,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-28 20:54:36,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:54:36,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-28 20:54:36,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase:namespace' member 'jenkins-hbase17.apache.org,43845,1690577663448': 2023-07-28 20:54:36,704 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase:namespace' execution completed 2023-07-28 20:54:36,704 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-28 20:54:36,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43845,1690577663448' released barrier for procedure'hbase:namespace', counting down latch. Waiting for 0 more 2023-07-28 20:54:36,704 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-28 20:54:36,705 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase:namespace 2023-07-28 20:54:36,705 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase:namespaceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-28 20:54:36,706 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-07-28 20:54:36,706 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-07-28 20:54:36,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase:namespace 2023-07-28 20:54:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase:namespace 2023-07-28 20:54:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-07-28 20:54:36,706 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-28 20:54:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:54:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:54:36,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-28 20:54:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:54:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:54:36,707 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase:namespace 2023-07-28 20:54:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-28 20:54:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:54:36,709 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-28 20:54:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:54:36,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase:namespace 2023-07-28 20:54:36,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,717 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-28 20:54:36,717 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-28 20:54:36,717 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-28 20:54:36,717 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-28 20:54:36,717 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase:namespace 2023-07-28 20:54:36,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:54:36,717 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:36,717 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-07-28 20:54:36,717 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase:namespace 2023-07-28 20:54:36,718 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase:namespace 2023-07-28 20:54:36,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase:namespace' 2023-07-28 20:54:36,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-28 20:54:36,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-28 20:54:36,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:54:36,720 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-28 20:54:36,723 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase:namespace'' to complete. (max 20000 ms per retry) 2023-07-28 20:54:36,723 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-28 20:54:46,723 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-28 20:54:46,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-28 20:54:46,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-28 20:54:46,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,760 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-28 20:54:46,760 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-28 20:54:46,765 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-28 20:54:46,765 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-28 20:54:46,765 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,766 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,767 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-28 20:54:46,767 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-28 20:54:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:54:46,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,768 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,769 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-28 20:54:46,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-28 20:54:46,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,769 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,769 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,770 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-28 20:54:46,770 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-28 20:54:46,770 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-28 20:54:46,772 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-28 20:54:46,772 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-28 20:54:46,776 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:54:46,776 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. started... 2023-07-28 20:54:46,777 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b9a5f08d2375621602c912889a175914 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-28 20:54:46,798 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/.tmp/info/59ffac5c9a3e4be4a3d2457b00bec0d6 2023-07-28 20:54:46,807 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/.tmp/info/59ffac5c9a3e4be4a3d2457b00bec0d6 as hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/59ffac5c9a3e4be4a3d2457b00bec0d6 2023-07-28 20:54:46,817 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/59ffac5c9a3e4be4a3d2457b00bec0d6, entries=1, sequenceid=5, filesize=5.8 K 2023-07-28 20:54:46,818 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for b9a5f08d2375621602c912889a175914 in 41ms, sequenceid=5, compaction requested=false 2023-07-28 20:54:46,819 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b9a5f08d2375621602c912889a175914: 2023-07-28 20:54:46,819 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:54:46,819 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-28 20:54:46,819 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-28 20:54:46,819 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,820 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-28 20:54:46,820 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43845,1690577663448' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-28 20:54:46,821 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,821 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:54:46,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:54:46,821 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,821 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-28 20:54:46,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:54:46,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:54:46,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:54:46,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43845,1690577663448' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-28 20:54:46,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41e152b0[Count = 0] remaining members to acquire global barrier 2023-07-28 20:54:46,826 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-28 20:54:46,826 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,827 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,827 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-28 20:54:46,827 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-28 20:54:46,827 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase17.apache.org,43845,1690577663448' in zk 2023-07-28 20:54:46,828 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,828 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-28 20:54:46,829 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-28 20:54:46,829 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,829 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-28 20:54:46,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,829 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-28 20:54:46,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:54:46,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:54:46,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:54:46,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:54:46,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:54:46,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase17.apache.org,43845,1690577663448': 2023-07-28 20:54:46,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43845,1690577663448' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-28 20:54:46,840 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-28 20:54:46,840 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-28 20:54:46,840 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-28 20:54:46,840 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,840 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-28 20:54:46,844 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,845 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-28 20:54:46,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-28 20:54:46,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:54:46,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,848 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:54:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:54:46,854 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:54:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:54:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,857 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:54:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,860 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,860 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-28 20:54:46,860 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-28 20:54:46,861 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,861 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-28 20:54:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:54:46,861 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:46,861 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,861 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-28 20:54:46,861 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,861 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:46,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-28 20:54:46,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-28 20:54:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:54:46,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-28 20:54:46,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-28 20:54:46,865 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-28 20:54:46,865 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-28 20:54:56,865 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-28 20:54:56,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-28 20:54:56,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-28 20:54:56,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-07-28 20:54:56,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,881 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-28 20:54:56,881 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-28 20:54:56,882 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-28 20:54:56,882 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-28 20:54:56,884 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,884 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,885 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,885 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-28 20:54:56,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-28 20:54:56,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:54:56,886 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,886 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-28 20:54:56,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-28 20:54:56,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,887 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,887 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-07-28 20:54:56,887 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,887 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-28 20:54:56,887 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-28 20:54:56,888 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-28 20:54:56,888 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-28 20:54:56,888 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-28 20:54:56,888 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:54:56,889 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. started... 2023-07-28 20:54:56,889 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b9a5f08d2375621602c912889a175914 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-28 20:54:56,929 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/.tmp/info/40af7d9d19f34e3e928e75f8d2fbb750 2023-07-28 20:54:56,950 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/.tmp/info/40af7d9d19f34e3e928e75f8d2fbb750 as hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/40af7d9d19f34e3e928e75f8d2fbb750 2023-07-28 20:54:56,961 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/40af7d9d19f34e3e928e75f8d2fbb750, entries=1, sequenceid=9, filesize=5.8 K 2023-07-28 20:54:56,962 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for b9a5f08d2375621602c912889a175914 in 73ms, sequenceid=9, compaction requested=false 2023-07-28 20:54:56,963 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b9a5f08d2375621602c912889a175914: 2023-07-28 20:54:56,963 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:54:56,963 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-28 20:54:56,963 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-28 20:54:56,963 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,964 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-28 20:54:56,964 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43845,1690577663448' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-28 20:54:56,966 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,966 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:54:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:54:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:54:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:54:56,968 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,968 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-28 20:54:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:54:56,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43845,1690577663448' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-28 20:54:56,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e3d4e8[Count = 0] remaining members to acquire global barrier 2023-07-28 20:54:56,973 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-28 20:54:56,973 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,974 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,974 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-28 20:54:56,974 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-28 20:54:56,974 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase17.apache.org,43845,1690577663448' in zk 2023-07-28 20:54:56,975 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-28 20:54:56,975 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,975 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-28 20:54:56,975 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-28 20:54:56,976 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43845,1690577663448' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-28 20:54:56,976 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-28 20:54:56,976 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-28 20:54:56,976 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-28 20:54:56,976 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-28 20:54:56,976 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,976 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-28 20:54:56,978 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,978 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-28 20:54:56,978 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:54:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:54:56,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-28 20:54:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:54:56,978 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:54:56,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:54:56,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,980 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:54:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,983 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,983 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-28 20:54:56,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-28 20:54:56,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:54:56,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-28 20:54:56,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-28 20:54:56,983 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-28 20:54:56,983 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-28 20:54:56,983 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-28 20:54:56,984 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,984 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:54:56,984 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,984 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,985 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:54:56,985 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-28 20:54:56,985 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-28 20:54:56,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-28 20:54:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:55:06,985 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-28 20:55:06,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-28 20:55:07,008 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33323,DS-28d70e4f-a9c1-44da-8fc8-454b7255d720,DISK] 2023-07-28 20:55:07,009 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41913,DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff,DISK] 2023-07-28 20:55:07,014 INFO [Listener at localhost.localdomain/38345] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577664840 with entries=13, filesize=6.36 KB; new WAL /user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577706989 2023-07-28 20:55:07,014 DEBUG [Listener at localhost.localdomain/38345] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41913,DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff,DISK], DatanodeInfoWithStorage[127.0.0.1:33323,DS-28d70e4f-a9c1-44da-8fc8-454b7255d720,DISK]] 2023-07-28 20:55:07,014 DEBUG [Listener at localhost.localdomain/38345] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577664840 is not closed yet, will try archiving it next time 2023-07-28 20:55:07,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-28 20:55:07,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-07-28 20:55:07,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,036 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-28 20:55:07,036 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-28 20:55:07,037 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-28 20:55:07,037 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-28 20:55:07,040 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,041 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,041 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,041 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-28 20:55:07,042 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,042 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-28 20:55:07,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-28 20:55:07,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:55:07,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-28 20:55:07,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,046 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,048 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-07-28 20:55:07,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,048 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-28 20:55:07,048 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-28 20:55:07,052 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-28 20:55:07,053 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-28 20:55:07,053 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-28 20:55:07,053 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:55:07,053 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. started... 2023-07-28 20:55:07,053 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b9a5f08d2375621602c912889a175914 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-28 20:55:07,485 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=13 (bloomFilter=true), to=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/.tmp/info/898cf3555f0c48f2aa066a7138e86bc1 2023-07-28 20:55:07,494 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/.tmp/info/898cf3555f0c48f2aa066a7138e86bc1 as hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/898cf3555f0c48f2aa066a7138e86bc1 2023-07-28 20:55:07,502 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/898cf3555f0c48f2aa066a7138e86bc1, entries=1, sequenceid=13, filesize=5.8 K 2023-07-28 20:55:07,504 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for b9a5f08d2375621602c912889a175914 in 451ms, sequenceid=13, compaction requested=true 2023-07-28 20:55:07,504 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b9a5f08d2375621602c912889a175914: 2023-07-28 20:55:07,504 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:55:07,504 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-28 20:55:07,505 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-28 20:55:07,505 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,505 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-28 20:55:07,505 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43845,1690577663448' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-28 20:55:07,506 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,506 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:55:07,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:55:07,507 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,507 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-28 20:55:07,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:55:07,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:55:07,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:55:07,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43845,1690577663448' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-28 20:55:07,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6363a8d[Count = 0] remaining members to acquire global barrier 2023-07-28 20:55:07,508 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-28 20:55:07,508 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,509 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,509 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-28 20:55:07,509 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-28 20:55:07,509 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase17.apache.org,43845,1690577663448' in zk 2023-07-28 20:55:07,509 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,509 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-28 20:55:07,510 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,510 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-28 20:55:07,510 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-28 20:55:07,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,510 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-28 20:55:07,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:55:07,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:55:07,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:55:07,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:55:07,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:55:07,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' member 'jenkins-hbase17.apache.org,43845,1690577663448': 2023-07-28 20:55:07,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43845,1690577663448' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-28 20:55:07,514 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-28 20:55:07,514 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-28 20:55:07,514 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-28 20:55:07,514 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,514 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-28 20:55:07,515 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,515 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-28 20:55:07,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,515 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:55:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:55:07,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-28 20:55:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:55:07,515 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:55:07,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:55:07,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,516 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:55:07,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,518 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,518 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,518 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,518 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-28 20:55:07,518 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-28 20:55:07,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-28 20:55:07,518 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:07,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:55:07,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-28 20:55:07,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-28 20:55:07,518 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-28 20:55:07,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling because node does not exist (not an error) 2023-07-28 20:55:07,519 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,519 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-28 20:55:07,519 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:07,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:55:07,519 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-28 20:55:07,519 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-28 20:55:17,519 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-28 20:55:17,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-28 20:55:17,522 DEBUG [Listener at localhost.localdomain/38345] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-28 20:55:17,536 DEBUG [Listener at localhost.localdomain/38345] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 17694 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-28 20:55:17,539 DEBUG [Listener at localhost.localdomain/38345] regionserver.HStore(1912): b9a5f08d2375621602c912889a175914/info is initiating minor compaction (all files) 2023-07-28 20:55:17,539 INFO [Listener at localhost.localdomain/38345] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-28 20:55:17,539 INFO [Listener at localhost.localdomain/38345] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:17,539 INFO [Listener at localhost.localdomain/38345] regionserver.HRegion(2259): Starting compaction of b9a5f08d2375621602c912889a175914/info in TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:55:17,540 INFO [Listener at localhost.localdomain/38345] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/59ffac5c9a3e4be4a3d2457b00bec0d6, hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/40af7d9d19f34e3e928e75f8d2fbb750, hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/898cf3555f0c48f2aa066a7138e86bc1] into tmpdir=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/.tmp, totalSize=17.3 K 2023-07-28 20:55:17,542 DEBUG [Listener at localhost.localdomain/38345] compactions.Compactor(207): Compacting 59ffac5c9a3e4be4a3d2457b00bec0d6, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1690577686741 2023-07-28 20:55:17,546 DEBUG [Listener at localhost.localdomain/38345] compactions.Compactor(207): Compacting 40af7d9d19f34e3e928e75f8d2fbb750, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1690577696868 2023-07-28 20:55:17,547 DEBUG [Listener at localhost.localdomain/38345] compactions.Compactor(207): Compacting 898cf3555f0c48f2aa066a7138e86bc1, keycount=1, bloomtype=ROW, size=5.8 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1690577706988 2023-07-28 20:55:17,641 INFO [Listener at localhost.localdomain/38345] throttle.PressureAwareThroughputController(145): b9a5f08d2375621602c912889a175914#info#compaction#9 average throughput is unlimited, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-28 20:55:18,126 DEBUG [Listener at localhost.localdomain/38345] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/.tmp/info/cf112a145b8e42a48c37ab9d914e7324 as hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/cf112a145b8e42a48c37ab9d914e7324 2023-07-28 20:55:18,148 INFO [Listener at localhost.localdomain/38345] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b9a5f08d2375621602c912889a175914/info of b9a5f08d2375621602c912889a175914 into cf112a145b8e42a48c37ab9d914e7324(size=7.9 K), total size for store is 7.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-28 20:55:18,148 DEBUG [Listener at localhost.localdomain/38345] regionserver.HRegion(2289): Compaction status journal for b9a5f08d2375621602c912889a175914: 2023-07-28 20:55:18,168 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41913,DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff,DISK] 2023-07-28 20:55:18,168 DEBUG [RS-EventLoopGroup-6-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33323,DS-28d70e4f-a9c1-44da-8fc8-454b7255d720,DISK] 2023-07-28 20:55:18,184 INFO [Listener at localhost.localdomain/38345] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577706989 with entries=4, filesize=2.43 KB; new WAL /user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577718153 2023-07-28 20:55:18,185 DEBUG [Listener at localhost.localdomain/38345] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41913,DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff,DISK], DatanodeInfoWithStorage[127.0.0.1:33323,DS-28d70e4f-a9c1-44da-8fc8-454b7255d720,DISK]] 2023-07-28 20:55:18,185 DEBUG [Listener at localhost.localdomain/38345] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577706989 is not closed yet, will try archiving it next time 2023-07-28 20:55:18,185 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577664840 to hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/oldWALs/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577664840 2023-07-28 20:55:18,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(936): Client=jenkins//136.243.18.41 procedure request for: flush-table-proc 2023-07-28 20:55:18,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] procedure.ProcedureCoordinator(143): Procedure TestLogRolling-testCompactionRecordDoesntBlockRolling was in running list but was completed. Accepting new attempt. 2023-07-28 20:55:18,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] procedure.ProcedureCoordinator(165): Submitting procedure TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,200 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-28 20:55:18,200 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-28 20:55:18,201 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' 2023-07-28 20:55:18,201 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling', kicking off acquire phase on members. 2023-07-28 20:55:18,204 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,205 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,208 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-28 20:55:18,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-28 20:55:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:55:18,208 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,209 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,209 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-28 20:55:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-28 20:55:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,214 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,216 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc TestLogRolling-testCompactionRecordDoesntBlockRolling is still present, removing 2023-07-28 20:55:18,216 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,216 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' with timeout 60000ms 2023-07-28 20:55:18,216 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-28 20:55:18,217 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'acquire' stage 2023-07-28 20:55:18,217 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-28 20:55:18,217 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-28 20:55:18,217 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:55:18,218 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. started... 2023-07-28 20:55:18,218 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b9a5f08d2375621602c912889a175914 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-28 20:55:18,308 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=18 (bloomFilter=true), to=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/.tmp/info/98c9c6f0304d457c9ca7c720f66e9c28 2023-07-28 20:55:18,323 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/.tmp/info/98c9c6f0304d457c9ca7c720f66e9c28 as hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/98c9c6f0304d457c9ca7c720f66e9c28 2023-07-28 20:55:18,337 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/98c9c6f0304d457c9ca7c720f66e9c28, entries=1, sequenceid=18, filesize=5.8 K 2023-07-28 20:55:18,339 INFO [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for b9a5f08d2375621602c912889a175914 in 120ms, sequenceid=18, compaction requested=false 2023-07-28 20:55:18,339 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b9a5f08d2375621602c912889a175914: 2023-07-28 20:55:18,339 DEBUG [rs(jenkins-hbase17.apache.org,43845,1690577663448)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:55:18,339 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-28 20:55:18,340 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-28 20:55:18,340 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,340 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally acquired 2023-07-28 20:55:18,340 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43845,1690577663448' joining acquired barrier for procedure (TestLogRolling-testCompactionRecordDoesntBlockRolling) in zk 2023-07-28 20:55:18,342 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,342 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:55:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:55:18,343 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,343 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-28 20:55:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:55:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:55:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:55:18,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43845,1690577663448' joining acquired barrier for procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' on coordinator 2023-07-28 20:55:18,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35ad54de[Count = 0] remaining members to acquire global barrier 2023-07-28 20:55:18,355 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' starting 'in-barrier' execution. 2023-07-28 20:55:18,355 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,357 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,358 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' received 'reached' from coordinator. 2023-07-28 20:55:18,358 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' locally completed 2023-07-28 20:55:18,358 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed for member 'jenkins-hbase17.apache.org,43845,1690577663448' in zk 2023-07-28 20:55:18,360 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' has notified controller of completion 2023-07-28 20:55:18,360 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-28 20:55:18,360 DEBUG [member: 'jenkins-hbase17.apache.org,43845,1690577663448' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' completed. 2023-07-28 20:55:18,370 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,371 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43845,1690577663448' released barrier for procedure'TestLogRolling-testCompactionRecordDoesntBlockRolling', counting down latch. Waiting for 0 more 2023-07-28 20:55:18,371 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-28 20:55:18,371 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'TestLogRolling-testCompactionRecordDoesntBlockRolling' execution completed 2023-07-28 20:55:18,371 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-28 20:55:18,371 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-28 20:55:18,371 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,371 INFO [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure TestLogRolling-testCompactionRecordDoesntBlockRollingincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-28 20:55:18,394 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,395 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-28 20:55:18,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-28 20:55:18,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:55:18,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,398 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,400 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-28 20:55:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-28 20:55:18,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-28 20:55:18,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-28 20:55:18,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-28 20:55:18,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,433 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,453 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-28 20:55:18,453 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-28 20:55:18,453 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,453 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,453 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,453 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:18,453 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,453 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,453 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/TestLogRolling-testCompactionRecordDoesntBlockRolling 2023-07-28 20:55:18,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-28 20:55:18,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:55:18,453 DEBUG [(jenkins-hbase17.apache.org,38161,1690577663323)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-28 20:55:18,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'TestLogRolling-testCompactionRecordDoesntBlockRolling' 2023-07-28 20:55:18,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-28 20:55:18,455 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : TestLogRolling-testCompactionRecordDoesntBlockRolling'' to complete. (max 20000 ms per retry) 2023-07-28 20:55:18,455 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2698): (#1) Sleeping: 10000ms while waiting for procedure completion. 2023-07-28 20:55:18,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-28 20:55:18,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:55:28,455 DEBUG [Listener at localhost.localdomain/38345] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-28 20:55:28,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38161] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-28 20:55:28,478 DEBUG [RS-EventLoopGroup-6-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41913,DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff,DISK] 2023-07-28 20:55:28,480 DEBUG [RS-EventLoopGroup-6-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33323,DS-28d70e4f-a9c1-44da-8fc8-454b7255d720,DISK] 2023-07-28 20:55:28,493 INFO [Listener at localhost.localdomain/38345] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577718153 with entries=3, filesize=1.94 KB; new WAL /user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577728460 2023-07-28 20:55:28,493 DEBUG [Listener at localhost.localdomain/38345] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41913,DS-5747fbdf-9155-4cae-a8e0-3c7da7ab42ff,DISK], DatanodeInfoWithStorage[127.0.0.1:33323,DS-28d70e4f-a9c1-44da-8fc8-454b7255d720,DISK]] 2023-07-28 20:55:28,493 DEBUG [Listener at localhost.localdomain/38345] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577718153 is not closed yet, will try archiving it next time 2023-07-28 20:55:28,493 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-28 20:55:28,494 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/WALs/jenkins-hbase17.apache.org,43845,1690577663448/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577706989 to hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/oldWALs/jenkins-hbase17.apache.org%2C43845%2C1690577663448.1690577706989 2023-07-28 20:55:28,494 INFO [Listener at localhost.localdomain/38345] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-28 20:55:28,494 DEBUG [Listener at localhost.localdomain/38345] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ed0040d to 127.0.0.1:63555 2023-07-28 20:55:28,495 DEBUG [Listener at localhost.localdomain/38345] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:55:28,495 DEBUG [Listener at localhost.localdomain/38345] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-28 20:55:28,495 DEBUG [Listener at localhost.localdomain/38345] util.JVMClusterUtil(257): Found active master hash=2120829127, stopped=false 2023-07-28 20:55:28,495 INFO [Listener at localhost.localdomain/38345] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,38161,1690577663323 2023-07-28 20:55:28,496 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-28 20:55:28,496 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-28 20:55:28,496 INFO [Listener at localhost.localdomain/38345] procedure2.ProcedureExecutor(629): Stopping 2023-07-28 20:55:28,496 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:55:28,497 DEBUG [Listener at localhost.localdomain/38345] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36f68b7f to 127.0.0.1:63555 2023-07-28 20:55:28,498 DEBUG [Listener at localhost.localdomain/38345] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:55:28,498 INFO [Listener at localhost.localdomain/38345] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,43845,1690577663448' ***** 2023-07-28 20:55:28,498 INFO [Listener at localhost.localdomain/38345] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-28 20:55:28,498 INFO [RS:0;jenkins-hbase17:43845] regionserver.HeapMemoryManager(220): Stopping 2023-07-28 20:55:28,498 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-28 20:55:28,498 INFO [RS:0;jenkins-hbase17:43845] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-28 20:55:28,499 INFO [RS:0;jenkins-hbase17:43845] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-28 20:55:28,499 INFO [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(3305): Received CLOSE for 19031a0ee73e7f79f5d1465cab22919d 2023-07-28 20:55:28,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:55:28,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:55:28,504 INFO [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(3305): Received CLOSE for b9a5f08d2375621602c912889a175914 2023-07-28 20:55:28,504 INFO [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:28,504 DEBUG [RS:0;jenkins-hbase17:43845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x023b05e3 to 127.0.0.1:63555 2023-07-28 20:55:28,505 DEBUG [RS:0;jenkins-hbase17:43845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:55:28,505 INFO [RS:0;jenkins-hbase17:43845] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-28 20:55:28,505 INFO [RS:0;jenkins-hbase17:43845] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-28 20:55:28,505 INFO [RS:0;jenkins-hbase17:43845] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-28 20:55:28,505 INFO [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-28 20:55:28,505 INFO [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-28 20:55:28,505 DEBUG [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 19031a0ee73e7f79f5d1465cab22919d=hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d., b9a5f08d2375621602c912889a175914=TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.} 2023-07-28 20:55:28,509 DEBUG [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1504): Waiting on 1588230740, 19031a0ee73e7f79f5d1465cab22919d, b9a5f08d2375621602c912889a175914 2023-07-28 20:55:28,509 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-28 20:55:28,509 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-28 20:55:28,509 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-28 20:55:28,509 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-28 20:55:28,509 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-28 20:55:28,509 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.10 KB heapSize=5.61 KB 2023-07-28 20:55:28,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 19031a0ee73e7f79f5d1465cab22919d, disabling compactions & flushes 2023-07-28 20:55:28,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:55:28,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:55:28,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. after waiting 0 ms 2023-07-28 20:55:28,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:55:28,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/namespace/19031a0ee73e7f79f5d1465cab22919d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-28 20:55:28,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:55:28,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 19031a0ee73e7f79f5d1465cab22919d: 2023-07-28 20:55:28,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690577665562.19031a0ee73e7f79f5d1465cab22919d. 2023-07-28 20:55:28,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b9a5f08d2375621602c912889a175914, disabling compactions & flushes 2023-07-28 20:55:28,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:55:28,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:55:28,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. after waiting 0 ms 2023-07-28 20:55:28,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:55:28,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing b9a5f08d2375621602c912889a175914 1/1 column families, dataSize=1.03 KB heapSize=1.35 KB 2023-07-28 20:55:28,557 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.85 KB at sequenceid=14 (bloomFilter=false), to=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/.tmp/info/10caaa5d321a4077a70ff748bf43d1fb 2023-07-28 20:55:28,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.03 KB at sequenceid=22 (bloomFilter=true), to=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/.tmp/info/37e6ce004ebb47d68c5fe6ddc9634581 2023-07-28 20:55:28,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/.tmp/info/37e6ce004ebb47d68c5fe6ddc9634581 as hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/37e6ce004ebb47d68c5fe6ddc9634581 2023-07-28 20:55:28,653 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=264 B at sequenceid=14 (bloomFilter=false), to=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/.tmp/table/a06e088b869f4144887f435f40282026 2023-07-28 20:55:28,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/37e6ce004ebb47d68c5fe6ddc9634581, entries=1, sequenceid=22, filesize=5.8 K 2023-07-28 20:55:28,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.03 KB/1051, heapSize ~1.34 KB/1368, currentSize=0 B/0 for b9a5f08d2375621602c912889a175914 in 130ms, sequenceid=22, compaction requested=true 2023-07-28 20:55:28,677 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-28 20:55:28,677 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-28 20:55:28,679 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/59ffac5c9a3e4be4a3d2457b00bec0d6, hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/40af7d9d19f34e3e928e75f8d2fbb750, hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/898cf3555f0c48f2aa066a7138e86bc1] to archive 2023-07-28 20:55:28,687 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-28 20:55:28,687 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/.tmp/info/10caaa5d321a4077a70ff748bf43d1fb as hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/info/10caaa5d321a4077a70ff748bf43d1fb 2023-07-28 20:55:28,694 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-28 20:55:28,708 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/59ffac5c9a3e4be4a3d2457b00bec0d6 to hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/59ffac5c9a3e4be4a3d2457b00bec0d6 2023-07-28 20:55:28,709 DEBUG [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1504): Waiting on 1588230740, b9a5f08d2375621602c912889a175914 2023-07-28 20:55:28,715 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/40af7d9d19f34e3e928e75f8d2fbb750 to hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/40af7d9d19f34e3e928e75f8d2fbb750 2023-07-28 20:55:28,719 DEBUG [StoreCloser-TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/898cf3555f0c48f2aa066a7138e86bc1 to hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/archive/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/info/898cf3555f0c48f2aa066a7138e86bc1 2023-07-28 20:55:28,728 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/info/10caaa5d321a4077a70ff748bf43d1fb, entries=20, sequenceid=14, filesize=7.6 K 2023-07-28 20:55:28,740 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/.tmp/table/a06e088b869f4144887f435f40282026 as hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/table/a06e088b869f4144887f435f40282026 2023-07-28 20:55:28,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/table/a06e088b869f4144887f435f40282026, entries=4, sequenceid=14, filesize=4.9 K 2023-07-28 20:55:28,754 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.10 KB/3178, heapSize ~5.33 KB/5456, currentSize=0 B/0 for 1588230740 in 245ms, sequenceid=14, compaction requested=false 2023-07-28 20:55:28,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/default/TestLogRolling-testCompactionRecordDoesntBlockRolling/b9a5f08d2375621602c912889a175914/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2023-07-28 20:55:28,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:55:28,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b9a5f08d2375621602c912889a175914: 2023-07-28 20:55:28,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testCompactionRecordDoesntBlockRolling,,1690577666595.b9a5f08d2375621602c912889a175914. 2023-07-28 20:55:28,830 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-07-28 20:55:28,831 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-28 20:55:28,832 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-28 20:55:28,832 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-28 20:55:28,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-28 20:55:28,909 INFO [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,43845,1690577663448; all regions closed. 2023-07-28 20:55:28,931 DEBUG [RS:0;jenkins-hbase17:43845] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/oldWALs 2023-07-28 20:55:28,931 INFO [RS:0;jenkins-hbase17:43845] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C43845%2C1690577663448.meta:.meta(num 1690577665432) 2023-07-28 20:55:28,956 DEBUG [RS:0;jenkins-hbase17:43845] wal.AbstractFSWAL(1028): Moved 2 WAL file(s) to /user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/oldWALs 2023-07-28 20:55:28,956 INFO [RS:0;jenkins-hbase17:43845] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C43845%2C1690577663448:(num 1690577728460) 2023-07-28 20:55:28,956 DEBUG [RS:0;jenkins-hbase17:43845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:55:28,956 INFO [RS:0;jenkins-hbase17:43845] regionserver.LeaseManager(133): Closed leases 2023-07-28 20:55:28,957 INFO [RS:0;jenkins-hbase17:43845] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-28 20:55:28,957 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-28 20:55:28,961 INFO [RS:0;jenkins-hbase17:43845] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:43845 2023-07-28 20:55:28,964 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-28 20:55:28,964 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,43845,1690577663448 2023-07-28 20:55:28,964 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-28 20:55:28,964 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,43845,1690577663448] 2023-07-28 20:55:28,964 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,43845,1690577663448; numProcessing=1 2023-07-28 20:55:28,968 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,43845,1690577663448 already deleted, retry=false 2023-07-28 20:55:28,968 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,43845,1690577663448 expired; onlineServers=0 2023-07-28 20:55:28,968 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,38161,1690577663323' ***** 2023-07-28 20:55:28,968 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-28 20:55:28,969 DEBUG [M:0;jenkins-hbase17:38161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a56c3d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-28 20:55:28,969 INFO [M:0;jenkins-hbase17:38161] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,38161,1690577663323 2023-07-28 20:55:28,969 INFO [M:0;jenkins-hbase17:38161] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,38161,1690577663323; all regions closed. 2023-07-28 20:55:28,969 DEBUG [M:0;jenkins-hbase17:38161] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:55:28,969 DEBUG [M:0;jenkins-hbase17:38161] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-28 20:55:28,969 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-28 20:55:28,969 DEBUG [M:0;jenkins-hbase17:38161] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-28 20:55:28,969 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690577664444] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690577664444,5,FailOnTimeoutGroup] 2023-07-28 20:55:28,969 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690577664444] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690577664444,5,FailOnTimeoutGroup] 2023-07-28 20:55:28,969 INFO [M:0;jenkins-hbase17:38161] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-28 20:55:28,970 INFO [M:0;jenkins-hbase17:38161] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-28 20:55:28,974 INFO [M:0;jenkins-hbase17:38161] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-28 20:55:28,974 DEBUG [M:0;jenkins-hbase17:38161] master.HMaster(1512): Stopping service threads 2023-07-28 20:55:28,974 INFO [M:0;jenkins-hbase17:38161] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-28 20:55:28,975 ERROR [M:0;jenkins-hbase17:38161] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-28 20:55:28,975 INFO [M:0;jenkins-hbase17:38161] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-28 20:55:28,975 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-28 20:55:28,976 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-28 20:55:28,976 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:55:28,976 DEBUG [M:0;jenkins-hbase17:38161] zookeeper.ZKUtil(398): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-28 20:55:28,976 WARN [M:0;jenkins-hbase17:38161] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-28 20:55:28,976 INFO [M:0;jenkins-hbase17:38161] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-28 20:55:28,977 INFO [M:0;jenkins-hbase17:38161] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-28 20:55:28,977 DEBUG [M:0;jenkins-hbase17:38161] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-28 20:55:28,977 INFO [M:0;jenkins-hbase17:38161] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:55:28,977 DEBUG [M:0;jenkins-hbase17:38161] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:55:28,977 DEBUG [M:0;jenkins-hbase17:38161] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-28 20:55:28,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-28 20:55:28,977 DEBUG [M:0;jenkins-hbase17:38161] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:55:28,978 INFO [M:0;jenkins-hbase17:38161] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=38.92 KB heapSize=47.38 KB 2023-07-28 20:55:29,066 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:55:29,066 INFO [RS:0;jenkins-hbase17:43845] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,43845,1690577663448; zookeeper connection closed. 2023-07-28 20:55:29,067 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): regionserver:43845-0x101adb570400001, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:55:29,072 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2877e0d8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2877e0d8 2023-07-28 20:55:29,072 INFO [Listener at localhost.localdomain/38345] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-28 20:55:29,443 INFO [M:0;jenkins-hbase17:38161] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=38.92 KB at sequenceid=100 (bloomFilter=true), to=hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8f5b109933b445acbd0d19ec96ddd1b9 2023-07-28 20:55:29,465 INFO [M:0;jenkins-hbase17:38161] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f5b109933b445acbd0d19ec96ddd1b9 2023-07-28 20:55:29,471 DEBUG [M:0;jenkins-hbase17:38161] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8f5b109933b445acbd0d19ec96ddd1b9 as hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8f5b109933b445acbd0d19ec96ddd1b9 2023-07-28 20:55:29,491 INFO [M:0;jenkins-hbase17:38161] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f5b109933b445acbd0d19ec96ddd1b9 2023-07-28 20:55:29,491 INFO [M:0;jenkins-hbase17:38161] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37811/user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8f5b109933b445acbd0d19ec96ddd1b9, entries=11, sequenceid=100, filesize=6.1 K 2023-07-28 20:55:29,493 INFO [M:0;jenkins-hbase17:38161] regionserver.HRegion(2948): Finished flush of dataSize ~38.92 KB/39854, heapSize ~47.36 KB/48496, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 516ms, sequenceid=100, compaction requested=false 2023-07-28 20:55:29,522 INFO [M:0;jenkins-hbase17:38161] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:55:29,522 DEBUG [M:0;jenkins-hbase17:38161] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-28 20:55:29,556 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/102bce3e-c64c-2364-2ebd-8d490c117659/MasterData/WALs/jenkins-hbase17.apache.org,38161,1690577663323/jenkins-hbase17.apache.org%2C38161%2C1690577663323.1690577664200 not finished, retry = 0 2023-07-28 20:55:29,658 INFO [M:0;jenkins-hbase17:38161] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-28 20:55:29,658 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-28 20:55:29,658 INFO [M:0;jenkins-hbase17:38161] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:38161 2023-07-28 20:55:29,660 DEBUG [M:0;jenkins-hbase17:38161] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,38161,1690577663323 already deleted, retry=false 2023-07-28 20:55:29,762 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:55:29,762 DEBUG [Listener at localhost.localdomain/38345-EventThread] zookeeper.ZKWatcher(600): master:38161-0x101adb570400000, quorum=127.0.0.1:63555, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:55:29,762 INFO [M:0;jenkins-hbase17:38161] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,38161,1690577663323; zookeeper connection closed. 2023-07-28 20:55:29,763 WARN [Listener at localhost.localdomain/38345] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-28 20:55:29,775 INFO [Listener at localhost.localdomain/38345] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-28 20:55:29,880 WARN [BP-342731274-136.243.18.41-1690577662562 heartbeating to localhost.localdomain/127.0.0.1:37811] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-28 20:55:29,880 WARN [BP-342731274-136.243.18.41-1690577662562 heartbeating to localhost.localdomain/127.0.0.1:37811] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-342731274-136.243.18.41-1690577662562 (Datanode Uuid 7050bdfc-1637-4809-a168-10ac9bc95bfe) service to localhost.localdomain/127.0.0.1:37811 2023-07-28 20:55:29,881 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/cluster_f72de4d3-eff8-9b80-f119-4c7895f6fbbc/dfs/data/data3/current/BP-342731274-136.243.18.41-1690577662562] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:55:29,881 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/cluster_f72de4d3-eff8-9b80-f119-4c7895f6fbbc/dfs/data/data4/current/BP-342731274-136.243.18.41-1690577662562] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:55:29,883 WARN [Listener at localhost.localdomain/38345] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-28 20:55:29,906 INFO [Listener at localhost.localdomain/38345] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-28 20:55:30,013 WARN [BP-342731274-136.243.18.41-1690577662562 heartbeating to localhost.localdomain/127.0.0.1:37811] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-28 20:55:30,013 WARN [BP-342731274-136.243.18.41-1690577662562 heartbeating to localhost.localdomain/127.0.0.1:37811] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-342731274-136.243.18.41-1690577662562 (Datanode Uuid 5ef16cfe-1511-4e8b-b0a4-116a6821c13f) service to localhost.localdomain/127.0.0.1:37811 2023-07-28 20:55:30,014 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/cluster_f72de4d3-eff8-9b80-f119-4c7895f6fbbc/dfs/data/data1/current/BP-342731274-136.243.18.41-1690577662562] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:55:30,015 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/cluster_f72de4d3-eff8-9b80-f119-4c7895f6fbbc/dfs/data/data2/current/BP-342731274-136.243.18.41-1690577662562] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:55:30,051 INFO [Listener at localhost.localdomain/38345] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-28 20:55:30,052 WARN [813398695@qtp-1824635831-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:39881] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-28 20:55:30,057 WARN [813398695@qtp-1824635831-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:39881] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-28 20:55:30,169 INFO [Listener at localhost.localdomain/38345] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-28 20:55:30,195 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-28 20:55:30,210 INFO [Listener at localhost.localdomain/38345] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testCompactionRecordDoesntBlockRolling Thread=63 (was 77), OpenFileDescriptor=435 (was 467), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=991 (was 1568), ProcessCount=193 (was 193), AvailableMemoryMB=1189 (was 1985) 2023-07-28 20:55:30,226 INFO [Listener at localhost.localdomain/38345] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=64, OpenFileDescriptor=435, MaxFileDescriptor=60000, SystemLoadAverage=991, ProcessCount=193, AvailableMemoryMB=1186 2023-07-28 20:55:30,226 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-28 20:55:30,227 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/hadoop.log.dir so I do NOT create it in target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862 2023-07-28 20:55:30,227 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1cb0b813-30c1-efa0-f909-860bd61ced98/hadoop.tmp.dir so I do NOT create it in target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862 2023-07-28 20:55:30,227 INFO [Listener at localhost.localdomain/38345] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/cluster_eff16c4d-ebbe-35b6-7a5d-b1c176394bce, deleteOnExit=true 2023-07-28 20:55:30,227 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-28 20:55:30,227 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/test.cache.data in system properties and HBase conf 2023-07-28 20:55:30,227 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/hadoop.tmp.dir in system properties and HBase conf 2023-07-28 20:55:30,227 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/hadoop.log.dir in system properties and HBase conf 2023-07-28 20:55:30,228 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-28 20:55:30,228 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-28 20:55:30,228 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-28 20:55:30,228 DEBUG [Listener at localhost.localdomain/38345] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-28 20:55:30,229 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-28 20:55:30,230 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-28 20:55:30,230 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-28 20:55:30,230 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-28 20:55:30,230 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-28 20:55:30,230 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-28 20:55:30,231 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-28 20:55:30,231 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-28 20:55:30,231 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-28 20:55:30,231 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/nfs.dump.dir in system properties and HBase conf 2023-07-28 20:55:30,231 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/java.io.tmpdir in system properties and HBase conf 2023-07-28 20:55:30,231 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-28 20:55:30,232 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-28 20:55:30,232 INFO [Listener at localhost.localdomain/38345] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-28 20:55:30,241 WARN [Listener at localhost.localdomain/38345] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-28 20:55:30,241 WARN [Listener at localhost.localdomain/38345] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-28 20:55:30,280 WARN [Listener at localhost.localdomain/38345] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:55:30,282 INFO [Listener at localhost.localdomain/38345] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:55:30,296 INFO [Listener at localhost.localdomain/38345] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/java.io.tmpdir/Jetty_localhost_localdomain_42205_hdfs____.geq46l/webapp 2023-07-28 20:55:30,398 INFO [Listener at localhost.localdomain/38345] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:42205 2023-07-28 20:55:30,407 WARN [Listener at localhost.localdomain/38345] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-28 20:55:30,407 WARN [Listener at localhost.localdomain/38345] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-28 20:55:30,496 WARN [Listener at localhost.localdomain/37579] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:55:30,513 WARN [Listener at localhost.localdomain/37579] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-28 20:55:30,515 WARN [Listener at localhost.localdomain/37579] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:55:30,517 INFO [Listener at localhost.localdomain/37579] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:55:30,528 INFO [Listener at localhost.localdomain/37579] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/java.io.tmpdir/Jetty_localhost_37087_datanode____.r4y7ny/webapp 2023-07-28 20:55:30,644 INFO [Listener at localhost.localdomain/37579] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37087 2023-07-28 20:55:30,667 WARN [Listener at localhost.localdomain/35679] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:55:30,771 WARN [Listener at localhost.localdomain/35679] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-28 20:55:30,787 WARN [Listener at localhost.localdomain/35679] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:55:30,789 INFO [Listener at localhost.localdomain/35679] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:55:30,798 INFO [Listener at localhost.localdomain/35679] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/java.io.tmpdir/Jetty_localhost_36585_datanode____.qe26ei/webapp 2023-07-28 20:55:30,931 INFO [Listener at localhost.localdomain/35679] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36585 2023-07-28 20:55:30,975 WARN [Listener at localhost.localdomain/45657] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:55:31,022 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe63b8419ce90f9b3: Processing first storage report for DS-bca9652b-97c3-42a6-bdab-5041070a55bf from datanode df103c06-3350-4702-9ae7-bad8f80ac0d5 2023-07-28 20:55:31,023 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe63b8419ce90f9b3: from storage DS-bca9652b-97c3-42a6-bdab-5041070a55bf node DatanodeRegistration(127.0.0.1:38249, datanodeUuid=df103c06-3350-4702-9ae7-bad8f80ac0d5, infoPort=34791, infoSecurePort=0, ipcPort=35679, storageInfo=lv=-57;cid=testClusterID;nsid=1702794611;c=1690577730244), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:55:31,023 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe63b8419ce90f9b3: Processing first storage report for DS-bb47ed61-6d9d-4786-8803-5b4ffc7edd89 from datanode df103c06-3350-4702-9ae7-bad8f80ac0d5 2023-07-28 20:55:31,023 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe63b8419ce90f9b3: from storage DS-bb47ed61-6d9d-4786-8803-5b4ffc7edd89 node DatanodeRegistration(127.0.0.1:38249, datanodeUuid=df103c06-3350-4702-9ae7-bad8f80ac0d5, infoPort=34791, infoSecurePort=0, ipcPort=35679, storageInfo=lv=-57;cid=testClusterID;nsid=1702794611;c=1690577730244), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-28 20:55:31,130 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7f6b391a0dc2854b: Processing first storage report for DS-563dead6-a2ab-4d7d-aef5-185aaeb43bfc from datanode 16cb2051-6b36-4a26-9740-a0ebda435ceb 2023-07-28 20:55:31,130 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7f6b391a0dc2854b: from storage DS-563dead6-a2ab-4d7d-aef5-185aaeb43bfc node DatanodeRegistration(127.0.0.1:40357, datanodeUuid=16cb2051-6b36-4a26-9740-a0ebda435ceb, infoPort=36097, infoSecurePort=0, ipcPort=45657, storageInfo=lv=-57;cid=testClusterID;nsid=1702794611;c=1690577730244), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:55:31,130 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7f6b391a0dc2854b: Processing first storage report for DS-8680c7a4-5315-4071-9658-04f3cc26a062 from datanode 16cb2051-6b36-4a26-9740-a0ebda435ceb 2023-07-28 20:55:31,131 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7f6b391a0dc2854b: from storage DS-8680c7a4-5315-4071-9658-04f3cc26a062 node DatanodeRegistration(127.0.0.1:40357, datanodeUuid=16cb2051-6b36-4a26-9740-a0ebda435ceb, infoPort=36097, infoSecurePort=0, ipcPort=45657, storageInfo=lv=-57;cid=testClusterID;nsid=1702794611;c=1690577730244), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:55:31,210 DEBUG [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862 2023-07-28 20:55:31,222 INFO [Listener at localhost.localdomain/45657] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/cluster_eff16c4d-ebbe-35b6-7a5d-b1c176394bce/zookeeper_0, clientPort=64180, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/cluster_eff16c4d-ebbe-35b6-7a5d-b1c176394bce/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/cluster_eff16c4d-ebbe-35b6-7a5d-b1c176394bce/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-28 20:55:31,232 INFO [Listener at localhost.localdomain/45657] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64180 2023-07-28 20:55:31,233 INFO [Listener at localhost.localdomain/45657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:55:31,234 INFO [Listener at localhost.localdomain/45657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:55:31,305 INFO [Listener at localhost.localdomain/45657] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8 with version=8 2023-07-28 20:55:31,305 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/hbase-staging 2023-07-28 20:55:31,307 INFO [Listener at localhost.localdomain/45657] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-28 20:55:31,308 INFO [Listener at localhost.localdomain/45657] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:55:31,308 INFO [Listener at localhost.localdomain/45657] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-28 20:55:31,308 INFO [Listener at localhost.localdomain/45657] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-28 20:55:31,308 INFO [Listener at localhost.localdomain/45657] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:55:31,308 INFO [Listener at localhost.localdomain/45657] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-28 20:55:31,308 INFO [Listener at localhost.localdomain/45657] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-28 20:55:31,315 INFO [Listener at localhost.localdomain/45657] ipc.NettyRpcServer(120): Bind to /136.243.18.41:36349 2023-07-28 20:55:31,316 INFO [Listener at localhost.localdomain/45657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:55:31,317 INFO [Listener at localhost.localdomain/45657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:55:31,319 INFO [Listener at localhost.localdomain/45657] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36349 connecting to ZooKeeper ensemble=127.0.0.1:64180 2023-07-28 20:55:31,335 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:363490x0, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-28 20:55:31,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36349-0x101adb679ad0000 connected 2023-07-28 20:55:31,449 DEBUG [Listener at localhost.localdomain/45657] zookeeper.ZKUtil(164): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-28 20:55:31,450 DEBUG [Listener at localhost.localdomain/45657] zookeeper.ZKUtil(164): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:55:31,452 DEBUG [Listener at localhost.localdomain/45657] zookeeper.ZKUtil(164): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-28 20:55:31,456 DEBUG [Listener at localhost.localdomain/45657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36349 2023-07-28 20:55:31,459 DEBUG [Listener at localhost.localdomain/45657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36349 2023-07-28 20:55:31,460 DEBUG [Listener at localhost.localdomain/45657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36349 2023-07-28 20:55:31,461 DEBUG [Listener at localhost.localdomain/45657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36349 2023-07-28 20:55:31,464 DEBUG [Listener at localhost.localdomain/45657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36349 2023-07-28 20:55:31,464 INFO [Listener at localhost.localdomain/45657] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8, hbase.cluster.distributed=false 2023-07-28 20:55:31,496 INFO [Listener at localhost.localdomain/45657] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-28 20:55:31,497 INFO [Listener at localhost.localdomain/45657] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:55:31,497 INFO [Listener at localhost.localdomain/45657] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-28 20:55:31,497 INFO [Listener at localhost.localdomain/45657] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-28 20:55:31,497 INFO [Listener at localhost.localdomain/45657] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:55:31,497 INFO [Listener at localhost.localdomain/45657] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-28 20:55:31,497 INFO [Listener at localhost.localdomain/45657] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-28 20:55:31,507 INFO [Listener at localhost.localdomain/45657] ipc.NettyRpcServer(120): Bind to /136.243.18.41:38479 2023-07-28 20:55:31,508 INFO [Listener at localhost.localdomain/45657] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-28 20:55:31,524 DEBUG [Listener at localhost.localdomain/45657] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-28 20:55:31,525 INFO [Listener at localhost.localdomain/45657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:55:31,526 INFO [Listener at localhost.localdomain/45657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:55:31,528 INFO [Listener at localhost.localdomain/45657] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38479 connecting to ZooKeeper ensemble=127.0.0.1:64180 2023-07-28 20:55:31,535 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): regionserver:384790x0, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-28 20:55:31,536 DEBUG [Listener at localhost.localdomain/45657] zookeeper.ZKUtil(164): regionserver:384790x0, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-28 20:55:31,537 DEBUG [Listener at localhost.localdomain/45657] zookeeper.ZKUtil(164): regionserver:384790x0, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:55:31,537 DEBUG [Listener at localhost.localdomain/45657] zookeeper.ZKUtil(164): regionserver:384790x0, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-28 20:55:31,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38479-0x101adb679ad0001 connected 2023-07-28 20:55:31,553 DEBUG [Listener at localhost.localdomain/45657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38479 2023-07-28 20:55:31,554 DEBUG [Listener at localhost.localdomain/45657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38479 2023-07-28 20:55:31,558 DEBUG [Listener at localhost.localdomain/45657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38479 2023-07-28 20:55:31,563 DEBUG [Listener at localhost.localdomain/45657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38479 2023-07-28 20:55:31,564 DEBUG [Listener at localhost.localdomain/45657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38479 2023-07-28 20:55:31,568 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,36349,1690577731307 2023-07-28 20:55:31,572 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-28 20:55:31,576 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,36349,1690577731307 2023-07-28 20:55:31,580 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-28 20:55:31,580 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:55:31,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-28 20:55:31,583 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): regionserver:38479-0x101adb679ad0001, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-28 20:55:31,586 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-28 20:55:31,587 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,36349,1690577731307 from backup master directory 2023-07-28 20:55:31,587 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,36349,1690577731307 2023-07-28 20:55:31,587 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-28 20:55:31,587 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-28 20:55:31,587 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,36349,1690577731307 2023-07-28 20:55:32,055 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/hbase.id with ID: 0a1253bf-cab9-45ef-927e-ed1939cac2ba 2023-07-28 20:55:32,083 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:55:32,092 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:55:32,153 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0fc59845 to 127.0.0.1:64180 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-28 20:55:32,170 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e3a59e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-28 20:55:32,171 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-28 20:55:32,172 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-28 20:55:32,173 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:55:32,192 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/data/master/store-tmp 2023-07-28 20:55:32,676 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:55:32,676 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-28 20:55:32,676 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:55:32,676 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:55:32,676 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-28 20:55:32,676 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:55:32,676 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:55:32,676 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-28 20:55:32,678 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/WALs/jenkins-hbase17.apache.org,36349,1690577731307 2023-07-28 20:55:32,682 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C36349%2C1690577731307, suffix=, logDir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/WALs/jenkins-hbase17.apache.org,36349,1690577731307, archiveDir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/oldWALs, maxLogs=10 2023-07-28 20:55:32,732 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40357,DS-563dead6-a2ab-4d7d-aef5-185aaeb43bfc,DISK] 2023-07-28 20:55:32,735 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38249,DS-bca9652b-97c3-42a6-bdab-5041070a55bf,DISK] 2023-07-28 20:55:32,752 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/WALs/jenkins-hbase17.apache.org,36349,1690577731307/jenkins-hbase17.apache.org%2C36349%2C1690577731307.1690577732682 2023-07-28 20:55:32,756 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40357,DS-563dead6-a2ab-4d7d-aef5-185aaeb43bfc,DISK], DatanodeInfoWithStorage[127.0.0.1:38249,DS-bca9652b-97c3-42a6-bdab-5041070a55bf,DISK]] 2023-07-28 20:55:32,757 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:55:32,757 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:55:32,757 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:55:32,757 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:55:32,768 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:55:32,792 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-28 20:55:32,793 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-28 20:55:32,804 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:55:32,810 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:55:32,820 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:55:32,841 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:55:32,846 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:55:32,856 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=838334, jitterRate=0.06599777936935425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:55:32,857 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-28 20:55:32,862 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-28 20:55:32,866 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-28 20:55:32,866 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-28 20:55:32,866 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-28 20:55:32,868 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-28 20:55:32,869 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-28 20:55:32,869 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-28 20:55:32,880 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-28 20:55:32,889 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-28 20:55:32,910 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-28 20:55:32,910 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-28 20:55:32,917 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-28 20:55:32,917 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-28 20:55:32,930 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-28 20:55:32,957 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:55:32,964 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-28 20:55:32,969 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-28 20:55:32,980 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-28 20:55:32,988 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): regionserver:38479-0x101adb679ad0001, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-28 20:55:32,988 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-28 20:55:32,988 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:55:32,989 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,36349,1690577731307, sessionid=0x101adb679ad0000, setting cluster-up flag (Was=false) 2023-07-28 20:55:32,991 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:55:32,994 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-28 20:55:33,002 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,36349,1690577731307 2023-07-28 20:55:33,009 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:55:33,013 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-28 20:55:33,015 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,36349,1690577731307 2023-07-28 20:55:33,016 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/.hbase-snapshot/.tmp 2023-07-28 20:55:33,032 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-28 20:55:33,033 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:55:33,033 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:55:33,033 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:55:33,033 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:55:33,033 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-28 20:55:33,033 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:55:33,033 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-28 20:55:33,033 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:55:33,053 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690577763048 2023-07-28 20:55:33,054 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-28 20:55:33,054 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-28 20:55:33,054 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-28 20:55:33,054 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-28 20:55:33,054 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-28 20:55:33,054 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-28 20:55:33,056 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,059 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-28 20:55:33,059 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-28 20:55:33,060 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-28 20:55:33,065 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-28 20:55:33,065 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-28 20:55:33,066 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-28 20:55:33,065 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-28 20:55:33,067 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690577733067,5,FailOnTimeoutGroup] 2023-07-28 20:55:33,068 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690577733068,5,FailOnTimeoutGroup] 2023-07-28 20:55:33,068 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,068 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-28 20:55:33,068 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,068 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,075 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-28 20:55:33,088 INFO [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(951): ClusterId : 0a1253bf-cab9-45ef-927e-ed1939cac2ba 2023-07-28 20:55:33,088 DEBUG [RS:0;jenkins-hbase17:38479] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-28 20:55:33,114 DEBUG [RS:0;jenkins-hbase17:38479] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-28 20:55:33,114 DEBUG [RS:0;jenkins-hbase17:38479] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-28 20:55:33,116 DEBUG [RS:0;jenkins-hbase17:38479] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-28 20:55:33,118 DEBUG [RS:0;jenkins-hbase17:38479] zookeeper.ReadOnlyZKClient(139): Connect 0x09716513 to 127.0.0.1:64180 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-28 20:55:33,136 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-28 20:55:33,141 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-28 20:55:33,142 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8 2023-07-28 20:55:33,152 DEBUG [RS:0;jenkins-hbase17:38479] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b69a4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-28 20:55:33,153 DEBUG [RS:0;jenkins-hbase17:38479] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3890e63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-28 20:55:33,182 DEBUG [RS:0;jenkins-hbase17:38479] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:38479 2023-07-28 20:55:33,182 INFO [RS:0;jenkins-hbase17:38479] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-28 20:55:33,182 INFO [RS:0;jenkins-hbase17:38479] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-28 20:55:33,182 DEBUG [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1022): About to register with Master. 2023-07-28 20:55:33,193 INFO [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,36349,1690577731307 with isa=jenkins-hbase17.apache.org/136.243.18.41:38479, startcode=1690577731496 2023-07-28 20:55:33,193 DEBUG [RS:0;jenkins-hbase17:38479] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-28 20:55:33,201 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:55:33,209 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55933, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-28 20:55:33,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-28 20:55:33,223 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36349] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:33,226 DEBUG [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8 2023-07-28 20:55:33,226 DEBUG [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37579 2023-07-28 20:55:33,226 DEBUG [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-28 20:55:33,237 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-28 20:55:33,240 DEBUG [RS:0;jenkins-hbase17:38479] zookeeper.ZKUtil(162): regionserver:38479-0x101adb679ad0001, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:33,241 WARN [RS:0;jenkins-hbase17:38479] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-28 20:55:33,241 INFO [RS:0;jenkins-hbase17:38479] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:55:33,241 DEBUG [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:33,254 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/info 2023-07-28 20:55:33,255 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-28 20:55:33,256 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,38479,1690577731496] 2023-07-28 20:55:33,264 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:55:33,269 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-28 20:55:33,285 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/rep_barrier 2023-07-28 20:55:33,286 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-28 20:55:33,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:55:33,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-28 20:55:33,297 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/table 2023-07-28 20:55:33,297 DEBUG [RS:0;jenkins-hbase17:38479] zookeeper.ZKUtil(162): regionserver:38479-0x101adb679ad0001, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:33,299 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-28 20:55:33,301 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:55:33,308 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740 2023-07-28 20:55:33,310 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740 2023-07-28 20:55:33,312 DEBUG [RS:0;jenkins-hbase17:38479] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-28 20:55:33,313 INFO [RS:0;jenkins-hbase17:38479] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-28 20:55:33,314 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-28 20:55:33,315 INFO [RS:0;jenkins-hbase17:38479] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-28 20:55:33,316 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-28 20:55:33,316 INFO [RS:0;jenkins-hbase17:38479] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-28 20:55:33,316 INFO [RS:0;jenkins-hbase17:38479] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,317 INFO [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-28 20:55:33,325 INFO [RS:0;jenkins-hbase17:38479] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,325 DEBUG [RS:0;jenkins-hbase17:38479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:55:33,325 DEBUG [RS:0;jenkins-hbase17:38479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:55:33,326 DEBUG [RS:0;jenkins-hbase17:38479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:55:33,326 DEBUG [RS:0;jenkins-hbase17:38479] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:55:33,326 DEBUG [RS:0;jenkins-hbase17:38479] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:55:33,326 DEBUG [RS:0;jenkins-hbase17:38479] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-28 20:55:33,326 DEBUG [RS:0;jenkins-hbase17:38479] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:55:33,326 DEBUG [RS:0;jenkins-hbase17:38479] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:55:33,326 DEBUG [RS:0;jenkins-hbase17:38479] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:55:33,326 DEBUG [RS:0;jenkins-hbase17:38479] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:55:33,333 INFO [RS:0;jenkins-hbase17:38479] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,333 INFO [RS:0;jenkins-hbase17:38479] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,333 INFO [RS:0;jenkins-hbase17:38479] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,339 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:55:33,340 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=766604, jitterRate=-0.025212645530700684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-28 20:55:33,340 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-28 20:55:33,340 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-28 20:55:33,340 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-28 20:55:33,340 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-28 20:55:33,340 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-28 20:55:33,340 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-28 20:55:33,354 INFO [RS:0;jenkins-hbase17:38479] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-28 20:55:33,355 INFO [RS:0;jenkins-hbase17:38479] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38479,1690577731496-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,355 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-28 20:55:33,355 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-28 20:55:33,364 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-28 20:55:33,365 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-28 20:55:33,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-28 20:55:33,377 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-28 20:55:33,383 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-28 20:55:33,400 INFO [RS:0;jenkins-hbase17:38479] regionserver.Replication(203): jenkins-hbase17.apache.org,38479,1690577731496 started 2023-07-28 20:55:33,401 INFO [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,38479,1690577731496, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:38479, sessionid=0x101adb679ad0001 2023-07-28 20:55:33,401 DEBUG [RS:0;jenkins-hbase17:38479] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-28 20:55:33,401 DEBUG [RS:0;jenkins-hbase17:38479] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:33,401 DEBUG [RS:0;jenkins-hbase17:38479] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,38479,1690577731496' 2023-07-28 20:55:33,401 DEBUG [RS:0;jenkins-hbase17:38479] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:55:33,405 DEBUG [RS:0;jenkins-hbase17:38479] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:55:33,408 DEBUG [RS:0;jenkins-hbase17:38479] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-28 20:55:33,409 DEBUG [RS:0;jenkins-hbase17:38479] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-28 20:55:33,409 DEBUG [RS:0;jenkins-hbase17:38479] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:33,409 DEBUG [RS:0;jenkins-hbase17:38479] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,38479,1690577731496' 2023-07-28 20:55:33,409 DEBUG [RS:0;jenkins-hbase17:38479] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-28 20:55:33,410 DEBUG [RS:0;jenkins-hbase17:38479] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-28 20:55:33,413 DEBUG [RS:0;jenkins-hbase17:38479] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-28 20:55:33,413 INFO [RS:0;jenkins-hbase17:38479] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-28 20:55:33,413 INFO [RS:0;jenkins-hbase17:38479] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-28 20:55:33,516 INFO [RS:0;jenkins-hbase17:38479] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C38479%2C1690577731496, suffix=, logDir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496, archiveDir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/oldWALs, maxLogs=32 2023-07-28 20:55:33,534 DEBUG [jenkins-hbase17:36349] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-28 20:55:33,535 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,38479,1690577731496, state=OPENING 2023-07-28 20:55:33,541 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-28 20:55:33,553 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38249,DS-bca9652b-97c3-42a6-bdab-5041070a55bf,DISK] 2023-07-28 20:55:33,556 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40357,DS-563dead6-a2ab-4d7d-aef5-185aaeb43bfc,DISK] 2023-07-28 20:55:33,556 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:55:33,557 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,38479,1690577731496}] 2023-07-28 20:55:33,558 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-28 20:55:33,573 INFO [RS:0;jenkins-hbase17:38479] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496/jenkins-hbase17.apache.org%2C38479%2C1690577731496.1690577733518 2023-07-28 20:55:33,576 DEBUG [RS:0;jenkins-hbase17:38479] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38249,DS-bca9652b-97c3-42a6-bdab-5041070a55bf,DISK], DatanodeInfoWithStorage[127.0.0.1:40357,DS-563dead6-a2ab-4d7d-aef5-185aaeb43bfc,DISK]] 2023-07-28 20:55:33,735 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:33,735 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-28 20:55:33,739 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-28 20:55:33,747 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-28 20:55:33,747 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:55:33,749 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C38479%2C1690577731496.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496, archiveDir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/oldWALs, maxLogs=32 2023-07-28 20:55:33,768 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38249,DS-bca9652b-97c3-42a6-bdab-5041070a55bf,DISK] 2023-07-28 20:55:33,773 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40357,DS-563dead6-a2ab-4d7d-aef5-185aaeb43bfc,DISK] 2023-07-28 20:55:33,785 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496/jenkins-hbase17.apache.org%2C38479%2C1690577731496.meta.1690577733749.meta 2023-07-28 20:55:33,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38249,DS-bca9652b-97c3-42a6-bdab-5041070a55bf,DISK], DatanodeInfoWithStorage[127.0.0.1:40357,DS-563dead6-a2ab-4d7d-aef5-185aaeb43bfc,DISK]] 2023-07-28 20:55:33,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:55:33,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-28 20:55:33,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-28 20:55:33,787 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-28 20:55:33,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-28 20:55:33,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:55:33,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-28 20:55:33,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-28 20:55:33,792 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-28 20:55:33,794 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/info 2023-07-28 20:55:33,794 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/info 2023-07-28 20:55:33,795 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-28 20:55:33,795 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:55:33,795 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-28 20:55:33,797 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/rep_barrier 2023-07-28 20:55:33,797 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/rep_barrier 2023-07-28 20:55:33,797 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-28 20:55:33,798 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:55:33,798 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-28 20:55:33,800 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/table 2023-07-28 20:55:33,800 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/table 2023-07-28 20:55:33,800 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-28 20:55:33,801 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:55:33,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740 2023-07-28 20:55:33,805 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740 2023-07-28 20:55:33,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-28 20:55:33,811 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-28 20:55:33,812 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=780487, jitterRate=-0.007559821009635925}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-28 20:55:33,812 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-28 20:55:33,813 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690577733735 2023-07-28 20:55:33,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-28 20:55:33,819 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-28 20:55:33,820 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,38479,1690577731496, state=OPEN 2023-07-28 20:55:33,822 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-28 20:55:33,824 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-28 20:55:33,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-28 20:55:33,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,38479,1690577731496 in 265 msec 2023-07-28 20:55:33,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-28 20:55:33,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 464 msec 2023-07-28 20:55:33,839 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 804 msec 2023-07-28 20:55:33,839 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690577733839, completionTime=-1 2023-07-28 20:55:33,839 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-28 20:55:33,839 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-28 20:55:33,847 DEBUG [hconnection-0x519a8cdc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-28 20:55:33,850 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-28 20:55:33,853 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-28 20:55:33,853 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690577793853 2023-07-28 20:55:33,853 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690577853853 2023-07-28 20:55:33,853 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 13 msec 2023-07-28 20:55:33,876 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,36349,1690577731307-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,876 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,36349,1690577731307-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,876 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,36349,1690577731307-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,876 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:36349, period=300000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,876 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-28 20:55:33,876 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-28 20:55:33,876 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-28 20:55:33,883 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-28 20:55:33,883 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-28 20:55:33,897 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-28 20:55:33,901 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-28 20:55:33,920 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/.tmp/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0 2023-07-28 20:55:33,927 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/.tmp/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0 empty. 2023-07-28 20:55:33,929 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/.tmp/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0 2023-07-28 20:55:33,929 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-28 20:55:34,010 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-28 20:55:34,015 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 231e6ed31529ae2cdf24799142fe8de0, NAME => 'hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/.tmp 2023-07-28 20:55:34,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:55:34,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 231e6ed31529ae2cdf24799142fe8de0, disabling compactions & flushes 2023-07-28 20:55:34,040 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. 2023-07-28 20:55:34,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. 2023-07-28 20:55:34,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. after waiting 0 ms 2023-07-28 20:55:34,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. 2023-07-28 20:55:34,040 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. 2023-07-28 20:55:34,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 231e6ed31529ae2cdf24799142fe8de0: 2023-07-28 20:55:34,045 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-28 20:55:34,046 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690577734046"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690577734046"}]},"ts":"1690577734046"} 2023-07-28 20:55:34,049 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-28 20:55:34,050 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-28 20:55:34,050 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577734050"}]},"ts":"1690577734050"} 2023-07-28 20:55:34,051 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-28 20:55:34,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=231e6ed31529ae2cdf24799142fe8de0, ASSIGN}] 2023-07-28 20:55:34,060 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=231e6ed31529ae2cdf24799142fe8de0, ASSIGN 2023-07-28 20:55:34,061 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=231e6ed31529ae2cdf24799142fe8de0, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38479,1690577731496; forceNewPlan=false, retain=false 2023-07-28 20:55:34,103 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-28 20:55:34,212 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=231e6ed31529ae2cdf24799142fe8de0, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:34,213 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690577734212"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690577734212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690577734212"}]},"ts":"1690577734212"} 2023-07-28 20:55:34,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 231e6ed31529ae2cdf24799142fe8de0, server=jenkins-hbase17.apache.org,38479,1690577731496}] 2023-07-28 20:55:34,375 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. 2023-07-28 20:55:34,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 231e6ed31529ae2cdf24799142fe8de0, NAME => 'hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0.', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:55:34,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 231e6ed31529ae2cdf24799142fe8de0 2023-07-28 20:55:34,376 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:55:34,376 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 231e6ed31529ae2cdf24799142fe8de0 2023-07-28 20:55:34,376 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 231e6ed31529ae2cdf24799142fe8de0 2023-07-28 20:55:34,384 INFO [StoreOpener-231e6ed31529ae2cdf24799142fe8de0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 231e6ed31529ae2cdf24799142fe8de0 2023-07-28 20:55:34,387 DEBUG [StoreOpener-231e6ed31529ae2cdf24799142fe8de0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0/info 2023-07-28 20:55:34,387 DEBUG [StoreOpener-231e6ed31529ae2cdf24799142fe8de0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0/info 2023-07-28 20:55:34,388 INFO [StoreOpener-231e6ed31529ae2cdf24799142fe8de0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 231e6ed31529ae2cdf24799142fe8de0 columnFamilyName info 2023-07-28 20:55:34,390 INFO [StoreOpener-231e6ed31529ae2cdf24799142fe8de0-1] regionserver.HStore(310): Store=231e6ed31529ae2cdf24799142fe8de0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:55:34,391 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0 2023-07-28 20:55:34,393 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0 2023-07-28 20:55:34,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 231e6ed31529ae2cdf24799142fe8de0 2023-07-28 20:55:34,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:55:34,405 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 231e6ed31529ae2cdf24799142fe8de0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=834168, jitterRate=0.06069989502429962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:55:34,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 231e6ed31529ae2cdf24799142fe8de0: 2023-07-28 20:55:34,406 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0., pid=6, masterSystemTime=1690577734369 2023-07-28 20:55:34,409 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. 2023-07-28 20:55:34,410 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. 2023-07-28 20:55:34,414 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=231e6ed31529ae2cdf24799142fe8de0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:34,414 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690577734414"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690577734414"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690577734414"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690577734414"}]},"ts":"1690577734414"} 2023-07-28 20:55:34,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-28 20:55:34,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 231e6ed31529ae2cdf24799142fe8de0, server=jenkins-hbase17.apache.org,38479,1690577731496 in 200 msec 2023-07-28 20:55:34,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-28 20:55:34,427 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=231e6ed31529ae2cdf24799142fe8de0, ASSIGN in 366 msec 2023-07-28 20:55:34,428 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-28 20:55:34,429 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577734429"}]},"ts":"1690577734429"} 2023-07-28 20:55:34,436 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-28 20:55:34,445 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-28 20:55:34,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 569 msec 2023-07-28 20:55:34,485 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-28 20:55:34,486 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-28 20:55:34,486 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:55:34,506 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-28 20:55:34,561 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-28 20:55:34,578 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-28 20:55:34,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 84 msec 2023-07-28 20:55:34,624 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-28 20:55:34,700 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-28 20:55:34,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 101 msec 2023-07-28 20:55:34,748 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-28 20:55:34,756 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-28 20:55:34,757 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.170sec 2023-07-28 20:55:34,757 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-28 20:55:34,757 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-28 20:55:34,757 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-28 20:55:34,757 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,36349,1690577731307-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-28 20:55:34,757 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,36349,1690577731307-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-28 20:55:34,791 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-28 20:55:34,792 DEBUG [Listener at localhost.localdomain/45657] zookeeper.ReadOnlyZKClient(139): Connect 0x3c6198c6 to 127.0.0.1:64180 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-28 20:55:34,823 DEBUG [Listener at localhost.localdomain/45657] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b417459, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-28 20:55:34,829 DEBUG [hconnection-0x16185212-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-28 20:55:34,835 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-28 20:55:34,838 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,36349,1690577731307 2023-07-28 20:55:34,838 INFO [Listener at localhost.localdomain/45657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:55:34,856 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-28 20:55:34,856 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:55:34,864 INFO [Listener at localhost.localdomain/45657] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-28 20:55:34,879 DEBUG [Listener at localhost.localdomain/45657] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-28 20:55:34,888 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-28 20:55:34,893 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36349] util.TableDescriptorChecker(340): MAX_FILESIZE for table descriptor or "hbase.hregion.max.filesize" (786432) is too small, which might cause over splitting into unmanageable number of regions. 2023-07-28 20:55:34,893 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36349] util.TableDescriptorChecker(340): MEMSTORE_FLUSHSIZE for table descriptor or "hbase.hregion.memstore.flush.size" (8192) is too small, which might cause very frequent flushing. 2023-07-28 20:55:34,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36349] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-28 20:55:34,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36349] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestLogRolling-testLogRolling 2023-07-28 20:55:34,911 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_PRE_OPERATION 2023-07-28 20:55:34,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36349] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "TestLogRolling-testLogRolling" procId is: 9 2023-07-28 20:55:34,914 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-28 20:55:34,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36349] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-28 20:55:34,926 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/.tmp/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:34,937 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/.tmp/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee empty. 2023-07-28 20:55:34,940 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/.tmp/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:34,940 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestLogRolling-testLogRolling regions 2023-07-28 20:55:35,044 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/.tmp/data/default/TestLogRolling-testLogRolling/.tabledesc/.tableinfo.0000000001 2023-07-28 20:55:35,049 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(7675): creating {ENCODED => d2fba48c738898f36b7e77c73d6e87ee, NAME => 'TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestLogRolling-testLogRolling', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/.tmp 2023-07-28 20:55:35,144 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:55:35,144 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1604): Closing d2fba48c738898f36b7e77c73d6e87ee, disabling compactions & flushes 2023-07-28 20:55:35,144 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:55:35,144 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:55:35,144 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. after waiting 0 ms 2023-07-28 20:55:35,145 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:55:35,145 INFO [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:55:35,145 DEBUG [RegionOpenAndInit-TestLogRolling-testLogRolling-pool-0] regionserver.HRegion(1558): Region close journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:55:35,153 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ADD_TO_META 2023-07-28 20:55:35,157 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690577735156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690577735156"}]},"ts":"1690577735156"} 2023-07-28 20:55:35,159 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-28 20:55:35,163 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-28 20:55:35,163 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577735163"}]},"ts":"1690577735163"} 2023-07-28 20:55:35,165 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLING in hbase:meta 2023-07-28 20:55:35,168 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=d2fba48c738898f36b7e77c73d6e87ee, ASSIGN}] 2023-07-28 20:55:35,171 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=d2fba48c738898f36b7e77c73d6e87ee, ASSIGN 2023-07-28 20:55:35,172 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=d2fba48c738898f36b7e77c73d6e87ee, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38479,1690577731496; forceNewPlan=false, retain=false 2023-07-28 20:55:35,323 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d2fba48c738898f36b7e77c73d6e87ee, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:35,323 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690577735323"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690577735323"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690577735323"}]},"ts":"1690577735323"} 2023-07-28 20:55:35,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure d2fba48c738898f36b7e77c73d6e87ee, server=jenkins-hbase17.apache.org,38479,1690577731496}] 2023-07-28 20:55:35,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:55:35,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d2fba48c738898f36b7e77c73d6e87ee, NAME => 'TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:55:35,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:35,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:55:35,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:35,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:35,496 INFO [StoreOpener-d2fba48c738898f36b7e77c73d6e87ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:35,499 DEBUG [StoreOpener-d2fba48c738898f36b7e77c73d6e87ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info 2023-07-28 20:55:35,499 DEBUG [StoreOpener-d2fba48c738898f36b7e77c73d6e87ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info 2023-07-28 20:55:35,500 INFO [StoreOpener-d2fba48c738898f36b7e77c73d6e87ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2fba48c738898f36b7e77c73d6e87ee columnFamilyName info 2023-07-28 20:55:35,501 INFO [StoreOpener-d2fba48c738898f36b7e77c73d6e87ee-1] regionserver.HStore(310): Store=d2fba48c738898f36b7e77c73d6e87ee/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:55:35,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:35,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:35,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:35,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:55:35,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened d2fba48c738898f36b7e77c73d6e87ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=733275, jitterRate=-0.06759311258792877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:55:35,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:55:35,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee., pid=11, masterSystemTime=1690577735480 2023-07-28 20:55:35,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:55:35,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:55:35,545 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d2fba48c738898f36b7e77c73d6e87ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:35,545 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690577735545"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690577735545"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690577735545"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690577735545"}]},"ts":"1690577735545"} 2023-07-28 20:55:35,549 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-28 20:55:35,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure d2fba48c738898f36b7e77c73d6e87ee, server=jenkins-hbase17.apache.org,38479,1690577731496 in 220 msec 2023-07-28 20:55:35,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-28 20:55:35,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=d2fba48c738898f36b7e77c73d6e87ee, ASSIGN in 381 msec 2023-07-28 20:55:35,554 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-28 20:55:35,554 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestLogRolling-testLogRolling","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577735554"}]},"ts":"1690577735554"} 2023-07-28 20:55:35,556 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestLogRolling-testLogRolling, state=ENABLED in hbase:meta 2023-07-28 20:55:35,559 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestLogRolling-testLogRolling execute state=CREATE_TABLE_POST_OPERATION 2023-07-28 20:55:35,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=TestLogRolling-testLogRolling in 666 msec 2023-07-28 20:55:39,290 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-28 20:55:39,342 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-28 20:55:39,343 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-28 20:55:39,344 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestLogRolling-testLogRolling' 2023-07-28 20:55:44,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36349] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-28 20:55:44,919 INFO [Listener at localhost.localdomain/45657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestLogRolling-testLogRolling, procId: 9 completed 2023-07-28 20:55:44,922 DEBUG [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(2627): Found 1 regions for table TestLogRolling-testLogRolling 2023-07-28 20:55:44,922 DEBUG [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(2633): firstRegionName=TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:55:44,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:44,985 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing d2fba48c738898f36b7e77c73d6e87ee 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-28 20:55:45,054 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=12 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/4a6b0a41dedf46118e0880b07bb08c3a 2023-07-28 20:55:45,075 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/4a6b0a41dedf46118e0880b07bb08c3a as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4a6b0a41dedf46118e0880b07bb08c3a 2023-07-28 20:55:45,089 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4a6b0a41dedf46118e0880b07bb08c3a, entries=8, sequenceid=12, filesize=13.0 K 2023-07-28 20:55:45,104 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=12.32 KB/12612 for d2fba48c738898f36b7e77c73d6e87ee in 119ms, sequenceid=12, compaction requested=false 2023-07-28 20:55:45,109 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:55:45,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:45,113 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing d2fba48c738898f36b7e77c73d6e87ee 1/1 column families, dataSize=13.34 KB heapSize=14.57 KB 2023-07-28 20:55:45,207 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.34 KB at sequenceid=28 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/708eeeedb5e0413aa28bdef98109a9f6 2023-07-28 20:55:45,222 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/708eeeedb5e0413aa28bdef98109a9f6 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/708eeeedb5e0413aa28bdef98109a9f6 2023-07-28 20:55:45,249 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/708eeeedb5e0413aa28bdef98109a9f6, entries=13, sequenceid=28, filesize=18.1 K 2023-07-28 20:55:45,252 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~13.34 KB/13663, heapSize ~14.55 KB/14904, currentSize=11.29 KB/11561 for d2fba48c738898f36b7e77c73d6e87ee in 138ms, sequenceid=28, compaction requested=false 2023-07-28 20:55:45,252 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:55:45,252 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=31.1 K, sizeToCheck=16.0 K 2023-07-28 20:55:45,252 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-28 20:55:45,253 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/708eeeedb5e0413aa28bdef98109a9f6 because midkey is the same as first or last row 2023-07-28 20:55:47,161 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing d2fba48c738898f36b7e77c73d6e87ee 1/1 column families, dataSize=12.32 KB heapSize=13.47 KB 2023-07-28 20:55:47,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:47,281 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.32 KB at sequenceid=43 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/9ca1694500574b8ab065abea00b37e02 2023-07-28 20:55:47,330 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/9ca1694500574b8ab065abea00b37e02 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/9ca1694500574b8ab065abea00b37e02 2023-07-28 20:55:47,353 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=d2fba48c738898f36b7e77c73d6e87ee, server=jenkins-hbase17.apache.org,38479,1690577731496 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-28 20:55:47,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] ipc.CallRunner(144): callId: 59 service: ClientService methodName: Mutate size: 1.1 K connection: 136.243.18.41:50448 deadline: 1690577757352, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=d2fba48c738898f36b7e77c73d6e87ee, server=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:47,357 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/9ca1694500574b8ab065abea00b37e02, entries=12, sequenceid=43, filesize=17.1 K 2023-07-28 20:55:47,373 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~12.32 KB/12612, heapSize ~13.45 KB/13776, currentSize=17.45 KB/17867 for d2fba48c738898f36b7e77c73d6e87ee in 212ms, sequenceid=43, compaction requested=true 2023-07-28 20:55:47,373 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:55:47,374 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=48.2 K, sizeToCheck=16.0 K 2023-07-28 20:55:47,374 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-28 20:55:47,374 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/708eeeedb5e0413aa28bdef98109a9f6 because midkey is the same as first or last row 2023-07-28 20:55:47,379 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:55:47,380 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-28 20:55:47,393 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 49312 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-28 20:55:47,393 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1912): d2fba48c738898f36b7e77c73d6e87ee/info is initiating minor compaction (all files) 2023-07-28 20:55:47,393 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d2fba48c738898f36b7e77c73d6e87ee/info in TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:55:47,393 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4a6b0a41dedf46118e0880b07bb08c3a, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/708eeeedb5e0413aa28bdef98109a9f6, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/9ca1694500574b8ab065abea00b37e02] into tmpdir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp, totalSize=48.2 K 2023-07-28 20:55:47,396 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 4a6b0a41dedf46118e0880b07bb08c3a, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=12, earliestPutTs=1690577744929 2023-07-28 20:55:47,398 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 708eeeedb5e0413aa28bdef98109a9f6, keycount=13, bloomtype=ROW, size=18.1 K, encoding=NONE, compression=NONE, seqNum=28, earliestPutTs=1690577744988 2023-07-28 20:55:47,401 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 9ca1694500574b8ab065abea00b37e02, keycount=12, bloomtype=ROW, size=17.1 K, encoding=NONE, compression=NONE, seqNum=43, earliestPutTs=1690577745121 2023-07-28 20:55:47,480 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] throttle.PressureAwareThroughputController(145): d2fba48c738898f36b7e77c73d6e87ee#info#compaction#18 average throughput is 8.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-28 20:55:47,574 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/eac385ca6b1f4d77ab3c582cd89c49b7 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/eac385ca6b1f4d77ab3c582cd89c49b7 2023-07-28 20:55:47,584 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d2fba48c738898f36b7e77c73d6e87ee/info of d2fba48c738898f36b7e77c73d6e87ee into eac385ca6b1f4d77ab3c582cd89c49b7(size=38.8 K), total size for store is 38.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-28 20:55:47,585 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:55:47,585 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee., storeName=d2fba48c738898f36b7e77c73d6e87ee/info, priority=13, startTime=1690577747375; duration=0sec 2023-07-28 20:55:47,586 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=38.8 K, sizeToCheck=16.0 K 2023-07-28 20:55:47,587 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-28 20:55:47,587 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/eac385ca6b1f4d77ab3c582cd89c49b7 because midkey is the same as first or last row 2023-07-28 20:55:47,587 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:55:57,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:55:57,438 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing d2fba48c738898f36b7e77c73d6e87ee 1/1 column families, dataSize=18.47 KB heapSize=20.08 KB 2023-07-28 20:55:57,497 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=d2fba48c738898f36b7e77c73d6e87ee, server=jenkins-hbase17.apache.org,38479,1690577731496 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-28 20:55:57,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] ipc.CallRunner(144): callId: 73 service: ClientService methodName: Mutate size: 1.1 K connection: 136.243.18.41:50448 deadline: 1690577767497, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=d2fba48c738898f36b7e77c73d6e87ee, server=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:55:57,512 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=18.47 KB at sequenceid=65 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/3c234606a10b486cb21bd0d5b5066481 2023-07-28 20:55:57,533 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/3c234606a10b486cb21bd0d5b5066481 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3c234606a10b486cb21bd0d5b5066481 2023-07-28 20:55:57,562 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3c234606a10b486cb21bd0d5b5066481, entries=18, sequenceid=65, filesize=23.3 K 2023-07-28 20:55:57,570 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~18.47 KB/18918, heapSize ~20.06 KB/20544, currentSize=11.29 KB/11561 for d2fba48c738898f36b7e77c73d6e87ee in 132ms, sequenceid=65, compaction requested=false 2023-07-28 20:55:57,571 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:55:57,571 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=62.1 K, sizeToCheck=16.0 K 2023-07-28 20:55:57,571 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-28 20:55:57,571 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/eac385ca6b1f4d77ab3c582cd89c49b7 because midkey is the same as first or last row 2023-07-28 20:56:07,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:56:07,589 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing d2fba48c738898f36b7e77c73d6e87ee 1/1 column families, dataSize=12.32 KB heapSize=13.47 KB 2023-07-28 20:56:07,602 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.32 KB at sequenceid=80 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/4efdc3c8dbcf40849183cf9010b1a1ac 2023-07-28 20:56:07,610 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/4efdc3c8dbcf40849183cf9010b1a1ac as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4efdc3c8dbcf40849183cf9010b1a1ac 2023-07-28 20:56:07,618 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4efdc3c8dbcf40849183cf9010b1a1ac, entries=12, sequenceid=80, filesize=17.1 K 2023-07-28 20:56:07,620 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~12.32 KB/12612, heapSize ~13.45 KB/13776, currentSize=1.03 KB/1051 for d2fba48c738898f36b7e77c73d6e87ee in 30ms, sequenceid=80, compaction requested=true 2023-07-28 20:56:07,620 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:56:07,620 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=79.1 K, sizeToCheck=16.0 K 2023-07-28 20:56:07,620 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-28 20:56:07,620 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/eac385ca6b1f4d77ab3c582cd89c49b7 because midkey is the same as first or last row 2023-07-28 20:56:07,620 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:07,620 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-28 20:56:07,622 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 81035 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-28 20:56:07,622 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1912): d2fba48c738898f36b7e77c73d6e87ee/info is initiating minor compaction (all files) 2023-07-28 20:56:07,623 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d2fba48c738898f36b7e77c73d6e87ee/info in TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:56:07,623 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/eac385ca6b1f4d77ab3c582cd89c49b7, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3c234606a10b486cb21bd0d5b5066481, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4efdc3c8dbcf40849183cf9010b1a1ac] into tmpdir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp, totalSize=79.1 K 2023-07-28 20:56:07,623 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting eac385ca6b1f4d77ab3c582cd89c49b7, keycount=33, bloomtype=ROW, size=38.8 K, encoding=NONE, compression=NONE, seqNum=43, earliestPutTs=1690577744929 2023-07-28 20:56:07,624 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 3c234606a10b486cb21bd0d5b5066481, keycount=18, bloomtype=ROW, size=23.3 K, encoding=NONE, compression=NONE, seqNum=65, earliestPutTs=1690577747166 2023-07-28 20:56:07,624 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 4efdc3c8dbcf40849183cf9010b1a1ac, keycount=12, bloomtype=ROW, size=17.1 K, encoding=NONE, compression=NONE, seqNum=80, earliestPutTs=1690577757440 2023-07-28 20:56:07,642 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] throttle.PressureAwareThroughputController(145): d2fba48c738898f36b7e77c73d6e87ee#info#compaction#21 average throughput is 21.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-28 20:56:07,673 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/3229ae5f4fc041afb89d7a2e919bfa28 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3229ae5f4fc041afb89d7a2e919bfa28 2023-07-28 20:56:07,683 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d2fba48c738898f36b7e77c73d6e87ee/info of d2fba48c738898f36b7e77c73d6e87ee into 3229ae5f4fc041afb89d7a2e919bfa28(size=69.8 K), total size for store is 69.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-28 20:56:07,683 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:56:07,683 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee., storeName=d2fba48c738898f36b7e77c73d6e87ee/info, priority=13, startTime=1690577767620; duration=0sec 2023-07-28 20:56:07,683 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=69.8 K, sizeToCheck=16.0 K 2023-07-28 20:56:07,683 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-28 20:56:07,683 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3229ae5f4fc041afb89d7a2e919bfa28 because midkey is the same as first or last row 2023-07-28 20:56:07,684 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:09,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:56:09,601 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing d2fba48c738898f36b7e77c73d6e87ee 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-28 20:56:09,623 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=92 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/b9df319ba6994eb59ceec2e5c3657cf9 2023-07-28 20:56:09,632 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/b9df319ba6994eb59ceec2e5c3657cf9 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/b9df319ba6994eb59ceec2e5c3657cf9 2023-07-28 20:56:09,642 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/b9df319ba6994eb59ceec2e5c3657cf9, entries=8, sequenceid=92, filesize=13.0 K 2023-07-28 20:56:09,643 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=19.50 KB/19969 for d2fba48c738898f36b7e77c73d6e87ee in 42ms, sequenceid=92, compaction requested=false 2023-07-28 20:56:09,643 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:56:09,644 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=82.8 K, sizeToCheck=16.0 K 2023-07-28 20:56:09,644 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-28 20:56:09,644 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3229ae5f4fc041afb89d7a2e919bfa28 because midkey is the same as first or last row 2023-07-28 20:56:09,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:56:09,646 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing d2fba48c738898f36b7e77c73d6e87ee 1/1 column families, dataSize=21.55 KB heapSize=23.38 KB 2023-07-28 20:56:09,659 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=21.55 KB at sequenceid=116 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/bdd2bd65232c492aa77dde81907be814 2023-07-28 20:56:09,666 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/bdd2bd65232c492aa77dde81907be814 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/bdd2bd65232c492aa77dde81907be814 2023-07-28 20:56:09,672 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/bdd2bd65232c492aa77dde81907be814, entries=21, sequenceid=116, filesize=26.3 K 2023-07-28 20:56:09,673 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~21.55 KB/22071, heapSize ~23.37 KB/23928, currentSize=4.11 KB/4204 for d2fba48c738898f36b7e77c73d6e87ee in 27ms, sequenceid=116, compaction requested=true 2023-07-28 20:56:09,674 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:56:09,674 DEBUG [MemStoreFlusher.0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=109.1 K, sizeToCheck=16.0 K 2023-07-28 20:56:09,674 DEBUG [MemStoreFlusher.0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-28 20:56:09,674 DEBUG [MemStoreFlusher.0] regionserver.StoreUtils(129): cannot split hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3229ae5f4fc041afb89d7a2e919bfa28 because midkey is the same as first or last row 2023-07-28 20:56:09,674 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:09,674 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-28 20:56:09,676 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 111718 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-28 20:56:09,676 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1912): d2fba48c738898f36b7e77c73d6e87ee/info is initiating minor compaction (all files) 2023-07-28 20:56:09,676 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d2fba48c738898f36b7e77c73d6e87ee/info in TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:56:09,676 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3229ae5f4fc041afb89d7a2e919bfa28, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/b9df319ba6994eb59ceec2e5c3657cf9, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/bdd2bd65232c492aa77dde81907be814] into tmpdir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp, totalSize=109.1 K 2023-07-28 20:56:09,677 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 3229ae5f4fc041afb89d7a2e919bfa28, keycount=63, bloomtype=ROW, size=69.8 K, encoding=NONE, compression=NONE, seqNum=80, earliestPutTs=1690577744929 2023-07-28 20:56:09,678 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting b9df319ba6994eb59ceec2e5c3657cf9, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=92, earliestPutTs=1690577767590 2023-07-28 20:56:09,678 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting bdd2bd65232c492aa77dde81907be814, keycount=21, bloomtype=ROW, size=26.3 K, encoding=NONE, compression=NONE, seqNum=116, earliestPutTs=1690577769602 2023-07-28 20:56:09,695 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] throttle.PressureAwareThroughputController(145): d2fba48c738898f36b7e77c73d6e87ee#info#compaction#24 average throughput is 18.44 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-28 20:56:09,720 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/4fbbb6453b8943938d4ff81518e1385b as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4fbbb6453b8943938d4ff81518e1385b 2023-07-28 20:56:09,729 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d2fba48c738898f36b7e77c73d6e87ee/info of d2fba48c738898f36b7e77c73d6e87ee into 4fbbb6453b8943938d4ff81518e1385b(size=99.8 K), total size for store is 99.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-28 20:56:09,729 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:56:09,729 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee., storeName=d2fba48c738898f36b7e77c73d6e87ee/info, priority=13, startTime=1690577769674; duration=0sec 2023-07-28 20:56:09,729 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.ConstantSizeRegionSplitPolicy(109): Should split because info size=99.8 K, sizeToCheck=16.0 K 2023-07-28 20:56:09,729 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.IncreasingToUpperBoundRegionSplitPolicy(84): regionsWithCommonTable=1 2023-07-28 20:56:09,731 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit(227): Splitting TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee., compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:09,731 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:09,733 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36349] assignment.AssignmentManager(1140): Split request from jenkins-hbase17.apache.org,38479,1690577731496, parent={ENCODED => d2fba48c738898f36b7e77c73d6e87ee, NAME => 'TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.', STARTKEY => '', ENDKEY => ''} splitKey=row0064 2023-07-28 20:56:09,741 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36349] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:56:09,748 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36349] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=d2fba48c738898f36b7e77c73d6e87ee, daughterA=e2c4048b019097d3fb0f0accbf0c1005, daughterB=a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:09,749 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=d2fba48c738898f36b7e77c73d6e87ee, daughterA=e2c4048b019097d3fb0f0accbf0c1005, daughterB=a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:09,749 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=d2fba48c738898f36b7e77c73d6e87ee, daughterA=e2c4048b019097d3fb0f0accbf0c1005, daughterB=a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:09,749 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=d2fba48c738898f36b7e77c73d6e87ee, daughterA=e2c4048b019097d3fb0f0accbf0c1005, daughterB=a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:09,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=d2fba48c738898f36b7e77c73d6e87ee, UNASSIGN}] 2023-07-28 20:56:09,762 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=d2fba48c738898f36b7e77c73d6e87ee, UNASSIGN 2023-07-28 20:56:09,763 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d2fba48c738898f36b7e77c73d6e87ee, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:56:09,763 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690577769763"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690577769763"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690577769763"}]},"ts":"1690577769763"} 2023-07-28 20:56:09,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; CloseRegionProcedure d2fba48c738898f36b7e77c73d6e87ee, server=jenkins-hbase17.apache.org,38479,1690577731496}] 2023-07-28 20:56:09,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:56:09,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing d2fba48c738898f36b7e77c73d6e87ee, disabling compactions & flushes 2023-07-28 20:56:09,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:56:09,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:56:09,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. after waiting 0 ms 2023-07-28 20:56:09,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:56:09,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing d2fba48c738898f36b7e77c73d6e87ee 1/1 column families, dataSize=4.11 KB heapSize=4.66 KB 2023-07-28 20:56:09,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.11 KB at sequenceid=124 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/a19e38d94b8342d7978e2860becc6613 2023-07-28 20:56:09,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.tmp/info/a19e38d94b8342d7978e2860becc6613 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/a19e38d94b8342d7978e2860becc6613 2023-07-28 20:56:09,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/a19e38d94b8342d7978e2860becc6613, entries=4, sequenceid=124, filesize=8.8 K 2023-07-28 20:56:09,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~4.11 KB/4204, heapSize ~4.64 KB/4752, currentSize=0 B/0 for d2fba48c738898f36b7e77c73d6e87ee in 47ms, sequenceid=124, compaction requested=false 2023-07-28 20:56:09,985 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4a6b0a41dedf46118e0880b07bb08c3a, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/708eeeedb5e0413aa28bdef98109a9f6, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/eac385ca6b1f4d77ab3c582cd89c49b7, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/9ca1694500574b8ab065abea00b37e02, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3c234606a10b486cb21bd0d5b5066481, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3229ae5f4fc041afb89d7a2e919bfa28, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4efdc3c8dbcf40849183cf9010b1a1ac, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/b9df319ba6994eb59ceec2e5c3657cf9, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/bdd2bd65232c492aa77dde81907be814] to archive 2023-07-28 20:56:09,987 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-28 20:56:09,988 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4a6b0a41dedf46118e0880b07bb08c3a to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4a6b0a41dedf46118e0880b07bb08c3a 2023-07-28 20:56:09,990 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/708eeeedb5e0413aa28bdef98109a9f6 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/708eeeedb5e0413aa28bdef98109a9f6 2023-07-28 20:56:09,994 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/eac385ca6b1f4d77ab3c582cd89c49b7 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/eac385ca6b1f4d77ab3c582cd89c49b7 2023-07-28 20:56:09,995 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/9ca1694500574b8ab065abea00b37e02 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/9ca1694500574b8ab065abea00b37e02 2023-07-28 20:56:10,010 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3c234606a10b486cb21bd0d5b5066481 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3c234606a10b486cb21bd0d5b5066481 2023-07-28 20:56:10,011 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3229ae5f4fc041afb89d7a2e919bfa28 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/3229ae5f4fc041afb89d7a2e919bfa28 2023-07-28 20:56:10,013 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4efdc3c8dbcf40849183cf9010b1a1ac to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4efdc3c8dbcf40849183cf9010b1a1ac 2023-07-28 20:56:10,014 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/b9df319ba6994eb59ceec2e5c3657cf9 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/b9df319ba6994eb59ceec2e5c3657cf9 2023-07-28 20:56:10,016 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/bdd2bd65232c492aa77dde81907be814 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/bdd2bd65232c492aa77dde81907be814 2023-07-28 20:56:10,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/recovered.edits/127.seqid, newMaxSeqId=127, maxSeqId=1 2023-07-28 20:56:10,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. 2023-07-28 20:56:10,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for d2fba48c738898f36b7e77c73d6e87ee: 2023-07-28 20:56:10,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:56:10,029 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d2fba48c738898f36b7e77c73d6e87ee, regionState=CLOSED 2023-07-28 20:56:10,030 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690577770029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690577770029"}]},"ts":"1690577770029"} 2023-07-28 20:56:10,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-28 20:56:10,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; CloseRegionProcedure d2fba48c738898f36b7e77c73d6e87ee, server=jenkins-hbase17.apache.org,38479,1690577731496 in 266 msec 2023-07-28 20:56:10,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-28 20:56:10,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=d2fba48c738898f36b7e77c73d6e87ee, UNASSIGN in 275 msec 2023-07-28 20:56:10,051 INFO [PEWorker-3] assignment.SplitTableRegionProcedure(694): pid=12 splitting 2 storefiles, region=d2fba48c738898f36b7e77c73d6e87ee, threads=2 2023-07-28 20:56:10,051 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4fbbb6453b8943938d4ff81518e1385b for region: d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:56:10,051 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/a19e38d94b8342d7978e2860becc6613 for region: d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:56:10,159 DEBUG [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/a19e38d94b8342d7978e2860becc6613, top=true 2023-07-28 20:56:10,188 INFO [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/.splits/a1b1dbe7b803694909bcd4c878b269f4/info/TestLogRolling-testLogRolling=d2fba48c738898f36b7e77c73d6e87ee-a19e38d94b8342d7978e2860becc6613 for child: a1b1dbe7b803694909bcd4c878b269f4, parent: d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:56:10,188 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/a19e38d94b8342d7978e2860becc6613 for region: d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:56:10,216 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4fbbb6453b8943938d4ff81518e1385b for region: d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:56:10,217 DEBUG [PEWorker-3] assignment.SplitTableRegionProcedure(755): pid=12 split storefiles for region d2fba48c738898f36b7e77c73d6e87ee Daughter A: 1 storefiles, Daughter B: 2 storefiles. 2023-07-28 20:56:10,268 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005/recovered.edits/127.seqid, newMaxSeqId=127, maxSeqId=-1 2023-07-28 20:56:10,274 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/recovered.edits/127.seqid, newMaxSeqId=127, maxSeqId=-1 2023-07-28 20:56:10,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690577770277"},{"qualifier":"splitA","vlen":70,"tag":[],"timestamp":"1690577770277"},{"qualifier":"splitB","vlen":70,"tag":[],"timestamp":"1690577770277"}]},"ts":"1690577770277"} 2023-07-28 20:56:10,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1690577770277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690577770277"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690577770277"}]},"ts":"1690577770277"} 2023-07-28 20:56:10,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1690577770277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690577770277"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690577770277"}]},"ts":"1690577770277"} 2023-07-28 20:56:10,329 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38479] regionserver.HRegion(9158): Flush requested on 1588230740 2023-07-28 20:56:10,329 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy(69): Since none of the CFs were above the size, flushing all. 2023-07-28 20:56:10,329 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=4.82 KB heapSize=8.36 KB 2023-07-28 20:56:10,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e2c4048b019097d3fb0f0accbf0c1005, ASSIGN}, {pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=a1b1dbe7b803694909bcd4c878b269f4, ASSIGN}] 2023-07-28 20:56:10,348 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e2c4048b019097d3fb0f0accbf0c1005, ASSIGN 2023-07-28 20:56:10,348 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=a1b1dbe7b803694909bcd4c878b269f4, ASSIGN 2023-07-28 20:56:10,350 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=a1b1dbe7b803694909bcd4c878b269f4, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase17.apache.org,38479,1690577731496; forceNewPlan=false, retain=false 2023-07-28 20:56:10,350 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e2c4048b019097d3fb0f0accbf0c1005, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase17.apache.org,38479,1690577731496; forceNewPlan=false, retain=false 2023-07-28 20:56:10,358 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.61 KB at sequenceid=17 (bloomFilter=false), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/.tmp/info/27e6cadc9d1e465cad10d246ffee4944 2023-07-28 20:56:10,404 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=216 B at sequenceid=17 (bloomFilter=false), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/.tmp/table/a7bd1f948f414cdf8ac6b6d0cfa76197 2023-07-28 20:56:10,412 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/.tmp/info/27e6cadc9d1e465cad10d246ffee4944 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/info/27e6cadc9d1e465cad10d246ffee4944 2023-07-28 20:56:10,450 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/info/27e6cadc9d1e465cad10d246ffee4944, entries=29, sequenceid=17, filesize=8.6 K 2023-07-28 20:56:10,453 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/.tmp/table/a7bd1f948f414cdf8ac6b6d0cfa76197 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/table/a7bd1f948f414cdf8ac6b6d0cfa76197 2023-07-28 20:56:10,480 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/table/a7bd1f948f414cdf8ac6b6d0cfa76197, entries=4, sequenceid=17, filesize=4.8 K 2023-07-28 20:56:10,485 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~4.82 KB/4939, heapSize ~8.08 KB/8272, currentSize=0 B/0 for 1588230740 in 156ms, sequenceid=17, compaction requested=false 2023-07-28 20:56:10,486 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-07-28 20:56:10,502 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a1b1dbe7b803694909bcd4c878b269f4, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:56:10,502 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1690577770501"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690577770501"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690577770501"}]},"ts":"1690577770501"} 2023-07-28 20:56:10,502 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e2c4048b019097d3fb0f0accbf0c1005, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:56:10,503 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1690577770502"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690577770502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690577770502"}]},"ts":"1690577770502"} 2023-07-28 20:56:10,506 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure e2c4048b019097d3fb0f0accbf0c1005, server=jenkins-hbase17.apache.org,38479,1690577731496}] 2023-07-28 20:56:10,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=16, state=RUNNABLE; OpenRegionProcedure a1b1dbe7b803694909bcd4c878b269f4, server=jenkins-hbase17.apache.org,38479,1690577731496}] 2023-07-28 20:56:10,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005. 2023-07-28 20:56:10,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e2c4048b019097d3fb0f0accbf0c1005, NAME => 'TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005.', STARTKEY => '', ENDKEY => 'row0064'} 2023-07-28 20:56:10,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling e2c4048b019097d3fb0f0accbf0c1005 2023-07-28 20:56:10,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:56:10,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e2c4048b019097d3fb0f0accbf0c1005 2023-07-28 20:56:10,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e2c4048b019097d3fb0f0accbf0c1005 2023-07-28 20:56:10,669 INFO [StoreOpener-e2c4048b019097d3fb0f0accbf0c1005-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e2c4048b019097d3fb0f0accbf0c1005 2023-07-28 20:56:10,670 DEBUG [StoreOpener-e2c4048b019097d3fb0f0accbf0c1005-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005/info 2023-07-28 20:56:10,670 DEBUG [StoreOpener-e2c4048b019097d3fb0f0accbf0c1005-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005/info 2023-07-28 20:56:10,671 INFO [StoreOpener-e2c4048b019097d3fb0f0accbf0c1005-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2c4048b019097d3fb0f0accbf0c1005 columnFamilyName info 2023-07-28 20:56:10,699 DEBUG [StoreOpener-e2c4048b019097d3fb0f0accbf0c1005-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005/info/4fbbb6453b8943938d4ff81518e1385b.d2fba48c738898f36b7e77c73d6e87ee->hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4fbbb6453b8943938d4ff81518e1385b-bottom 2023-07-28 20:56:10,700 INFO [StoreOpener-e2c4048b019097d3fb0f0accbf0c1005-1] regionserver.HStore(310): Store=e2c4048b019097d3fb0f0accbf0c1005/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:56:10,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005 2023-07-28 20:56:10,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005 2023-07-28 20:56:10,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e2c4048b019097d3fb0f0accbf0c1005 2023-07-28 20:56:10,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e2c4048b019097d3fb0f0accbf0c1005; next sequenceid=128; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=856171, jitterRate=0.08867855370044708}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:56:10,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e2c4048b019097d3fb0f0accbf0c1005: 2023-07-28 20:56:10,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005., pid=17, masterSystemTime=1690577770660 2023-07-28 20:56:10,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:10,727 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-28 20:56:10,729 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005. 2023-07-28 20:56:10,729 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1912): e2c4048b019097d3fb0f0accbf0c1005/info is initiating minor compaction (all files) 2023-07-28 20:56:10,729 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e2c4048b019097d3fb0f0accbf0c1005/info in TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005. 2023-07-28 20:56:10,729 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005/info/4fbbb6453b8943938d4ff81518e1385b.d2fba48c738898f36b7e77c73d6e87ee->hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4fbbb6453b8943938d4ff81518e1385b-bottom] into tmpdir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005/.tmp, totalSize=99.8 K 2023-07-28 20:56:10,730 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 4fbbb6453b8943938d4ff81518e1385b.d2fba48c738898f36b7e77c73d6e87ee, keycount=46, bloomtype=ROW, size=99.8 K, encoding=NONE, compression=NONE, seqNum=116, earliestPutTs=1690577744929 2023-07-28 20:56:10,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005. 2023-07-28 20:56:10,749 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e2c4048b019097d3fb0f0accbf0c1005, regionState=OPEN, openSeqNum=128, regionLocation=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:56:10,752 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1690577770749"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690577770749"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690577770749"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690577770749"}]},"ts":"1690577770749"} 2023-07-28 20:56:10,755 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] throttle.PressureAwareThroughputController(145): e2c4048b019097d3fb0f0accbf0c1005#info#compaction#28 average throughput is 31.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-28 20:56:10,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005. 2023-07-28 20:56:10,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-07-28 20:56:10,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure e2c4048b019097d3fb0f0accbf0c1005, server=jenkins-hbase17.apache.org,38479,1690577731496 in 254 msec 2023-07-28 20:56:10,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:56:10,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1b1dbe7b803694909bcd4c878b269f4, NAME => 'TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.', STARTKEY => 'row0064', ENDKEY => ''} 2023-07-28 20:56:10,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestLogRolling-testLogRolling a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:10,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:56:10,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:10,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:10,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=e2c4048b019097d3fb0f0accbf0c1005, ASSIGN in 418 msec 2023-07-28 20:56:10,788 INFO [StoreOpener-a1b1dbe7b803694909bcd4c878b269f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:10,802 DEBUG [StoreOpener-a1b1dbe7b803694909bcd4c878b269f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info 2023-07-28 20:56:10,802 DEBUG [StoreOpener-a1b1dbe7b803694909bcd4c878b269f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info 2023-07-28 20:56:10,803 INFO [StoreOpener-a1b1dbe7b803694909bcd4c878b269f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1b1dbe7b803694909bcd4c878b269f4 columnFamilyName info 2023-07-28 20:56:10,839 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005/.tmp/info/6ae2f4eafd30479787dfe0069ab88a56 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005/info/6ae2f4eafd30479787dfe0069ab88a56 2023-07-28 20:56:10,845 DEBUG [StoreOpener-a1b1dbe7b803694909bcd4c878b269f4-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/4fbbb6453b8943938d4ff81518e1385b.d2fba48c738898f36b7e77c73d6e87ee->hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4fbbb6453b8943938d4ff81518e1385b-top 2023-07-28 20:56:10,856 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in e2c4048b019097d3fb0f0accbf0c1005/info of e2c4048b019097d3fb0f0accbf0c1005 into 6ae2f4eafd30479787dfe0069ab88a56(size=69.7 K), total size for store is 69.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-28 20:56:10,857 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e2c4048b019097d3fb0f0accbf0c1005: 2023-07-28 20:56:10,857 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005., storeName=e2c4048b019097d3fb0f0accbf0c1005/info, priority=15, startTime=1690577770726; duration=0sec 2023-07-28 20:56:10,857 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:10,866 DEBUG [StoreOpener-a1b1dbe7b803694909bcd4c878b269f4-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/TestLogRolling-testLogRolling=d2fba48c738898f36b7e77c73d6e87ee-a19e38d94b8342d7978e2860becc6613 2023-07-28 20:56:10,869 INFO [StoreOpener-a1b1dbe7b803694909bcd4c878b269f4-1] regionserver.HStore(310): Store=a1b1dbe7b803694909bcd4c878b269f4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:56:10,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:10,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:10,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:10,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a1b1dbe7b803694909bcd4c878b269f4; next sequenceid=128; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=814699, jitterRate=0.035943806171417236}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:56:10,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:10,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4., pid=18, masterSystemTime=1690577770660 2023-07-28 20:56:10,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:10,887 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 16 blocking 2023-07-28 20:56:10,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:56:10,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:56:10,889 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a1b1dbe7b803694909bcd4c878b269f4, regionState=OPEN, openSeqNum=128, regionLocation=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:56:10,889 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:56:10,889 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1690577770889"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690577770889"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690577770889"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690577770889"}]},"ts":"1690577770889"} 2023-07-28 20:56:10,889 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1912): a1b1dbe7b803694909bcd4c878b269f4/info is initiating minor compaction (all files) 2023-07-28 20:56:10,890 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a1b1dbe7b803694909bcd4c878b269f4/info in TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:56:10,890 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/4fbbb6453b8943938d4ff81518e1385b.d2fba48c738898f36b7e77c73d6e87ee->hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4fbbb6453b8943938d4ff81518e1385b-top, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/TestLogRolling-testLogRolling=d2fba48c738898f36b7e77c73d6e87ee-a19e38d94b8342d7978e2860becc6613] into tmpdir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp, totalSize=108.6 K 2023-07-28 20:56:10,891 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 4fbbb6453b8943938d4ff81518e1385b.d2fba48c738898f36b7e77c73d6e87ee, keycount=46, bloomtype=ROW, size=99.8 K, encoding=NONE, compression=NONE, seqNum=117, earliestPutTs=1690577744929 2023-07-28 20:56:10,892 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting TestLogRolling-testLogRolling=d2fba48c738898f36b7e77c73d6e87ee-a19e38d94b8342d7978e2860becc6613, keycount=4, bloomtype=ROW, size=8.8 K, encoding=NONE, compression=NONE, seqNum=124, earliestPutTs=1690577769647 2023-07-28 20:56:10,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=16 2023-07-28 20:56:10,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=16, state=SUCCESS; OpenRegionProcedure a1b1dbe7b803694909bcd4c878b269f4, server=jenkins-hbase17.apache.org,38479,1690577731496 in 383 msec 2023-07-28 20:56:10,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=12 2023-07-28 20:56:10,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestLogRolling-testLogRolling, region=a1b1dbe7b803694909bcd4c878b269f4, ASSIGN in 548 msec 2023-07-28 20:56:10,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; SplitTableRegionProcedure table=TestLogRolling-testLogRolling, parent=d2fba48c738898f36b7e77c73d6e87ee, daughterA=e2c4048b019097d3fb0f0accbf0c1005, daughterB=a1b1dbe7b803694909bcd4c878b269f4 in 1.1570 sec 2023-07-28 20:56:10,912 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] throttle.PressureAwareThroughputController(145): a1b1dbe7b803694909bcd4c878b269f4#info#compaction#29 average throughput is 16.54 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-28 20:56:10,962 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/338cc046dfb048e5984abacff5926eeb as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/338cc046dfb048e5984abacff5926eeb 2023-07-28 20:56:10,976 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 (all) file(s) in a1b1dbe7b803694909bcd4c878b269f4/info of a1b1dbe7b803694909bcd4c878b269f4 into 338cc046dfb048e5984abacff5926eeb(size=38.9 K), total size for store is 38.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-28 20:56:10,976 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:10,976 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4., storeName=a1b1dbe7b803694909bcd4c878b269f4/info, priority=14, startTime=1690577770885; duration=0sec 2023-07-28 20:56:10,976 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:11,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Mutate size: 1.1 K connection: 136.243.18.41:50448 deadline: 1690577781653, exception=org.apache.hadoop.hbase.NotServingRegionException: TestLogRolling-testLogRolling,,1690577734893.d2fba48c738898f36b7e77c73d6e87ee. is not online on jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:56:15,574 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-28 20:56:21,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:21,772 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing a1b1dbe7b803694909bcd4c878b269f4 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-28 20:56:21,927 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=a1b1dbe7b803694909bcd4c878b269f4, server=jenkins-hbase17.apache.org,38479,1690577731496 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-28 20:56:21,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 1.2 K connection: 136.243.18.41:50448 deadline: 1690577791927, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=a1b1dbe7b803694909bcd4c878b269f4, server=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:56:21,947 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=139 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/3ba7176b67c647d580df447966fe513e 2023-07-28 20:56:22,013 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/3ba7176b67c647d580df447966fe513e as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/3ba7176b67c647d580df447966fe513e 2023-07-28 20:56:22,056 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/3ba7176b67c647d580df447966fe513e, entries=8, sequenceid=139, filesize=13.0 K 2023-07-28 20:56:22,058 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for a1b1dbe7b803694909bcd4c878b269f4 in 286ms, sequenceid=139, compaction requested=false 2023-07-28 20:56:22,058 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:31,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:31,960 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing a1b1dbe7b803694909bcd4c878b269f4 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-28 20:56:32,018 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=164 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/ba9804b4b8b040a4a41747e7d85ebd51 2023-07-28 20:56:32,033 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/ba9804b4b8b040a4a41747e7d85ebd51 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/ba9804b4b8b040a4a41747e7d85ebd51 2023-07-28 20:56:32,045 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/ba9804b4b8b040a4a41747e7d85ebd51, entries=22, sequenceid=164, filesize=27.4 K 2023-07-28 20:56:32,046 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for a1b1dbe7b803694909bcd4c878b269f4 in 86ms, sequenceid=164, compaction requested=true 2023-07-28 20:56:32,047 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:32,047 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:32,047 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-28 20:56:32,049 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 81128 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-28 20:56:32,050 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1912): a1b1dbe7b803694909bcd4c878b269f4/info is initiating minor compaction (all files) 2023-07-28 20:56:32,050 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a1b1dbe7b803694909bcd4c878b269f4/info in TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:56:32,050 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/338cc046dfb048e5984abacff5926eeb, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/3ba7176b67c647d580df447966fe513e, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/ba9804b4b8b040a4a41747e7d85ebd51] into tmpdir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp, totalSize=79.2 K 2023-07-28 20:56:32,050 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 338cc046dfb048e5984abacff5926eeb, keycount=33, bloomtype=ROW, size=38.9 K, encoding=NONE, compression=NONE, seqNum=124, earliestPutTs=1690577767590 2023-07-28 20:56:32,050 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 3ba7176b67c647d580df447966fe513e, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=139, earliestPutTs=1690577781726 2023-07-28 20:56:32,051 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting ba9804b4b8b040a4a41747e7d85ebd51, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=164, earliestPutTs=1690577781776 2023-07-28 20:56:32,081 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] throttle.PressureAwareThroughputController(145): a1b1dbe7b803694909bcd4c878b269f4#info#compaction#32 average throughput is 63.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-28 20:56:32,594 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/fa1e7c6eede4438eacb273f76fb724ed as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/fa1e7c6eede4438eacb273f76fb724ed 2023-07-28 20:56:32,620 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a1b1dbe7b803694909bcd4c878b269f4/info of a1b1dbe7b803694909bcd4c878b269f4 into fa1e7c6eede4438eacb273f76fb724ed(size=69.9 K), total size for store is 69.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-28 20:56:32,621 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:32,621 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4., storeName=a1b1dbe7b803694909bcd4c878b269f4/info, priority=13, startTime=1690577792047; duration=0sec 2023-07-28 20:56:32,621 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:33,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:33,976 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing a1b1dbe7b803694909bcd4c878b269f4 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-28 20:56:34,020 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=a1b1dbe7b803694909bcd4c878b269f4, server=jenkins-hbase17.apache.org,38479,1690577731496 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-28 20:56:34,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] ipc.CallRunner(144): callId: 174 service: ClientService methodName: Mutate size: 1.2 K connection: 136.243.18.41:50448 deadline: 1690577804019, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=a1b1dbe7b803694909bcd4c878b269f4, server=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:56:34,031 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=176 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/470950ad08244694be33edb772ad150b 2023-07-28 20:56:34,039 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/470950ad08244694be33edb772ad150b as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/470950ad08244694be33edb772ad150b 2023-07-28 20:56:34,045 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/470950ad08244694be33edb772ad150b, entries=8, sequenceid=176, filesize=13.0 K 2023-07-28 20:56:34,048 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for a1b1dbe7b803694909bcd4c878b269f4 in 72ms, sequenceid=176, compaction requested=false 2023-07-28 20:56:34,048 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:44,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:44,064 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing a1b1dbe7b803694909bcd4c878b269f4 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-28 20:56:44,078 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=201 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/f514b4ea71b24fe79d870cd5d6b3a541 2023-07-28 20:56:44,084 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/f514b4ea71b24fe79d870cd5d6b3a541 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/f514b4ea71b24fe79d870cd5d6b3a541 2023-07-28 20:56:44,092 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/f514b4ea71b24fe79d870cd5d6b3a541, entries=22, sequenceid=201, filesize=27.4 K 2023-07-28 20:56:44,093 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=4.11 KB/4204 for a1b1dbe7b803694909bcd4c878b269f4 in 29ms, sequenceid=201, compaction requested=true 2023-07-28 20:56:44,093 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:44,093 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:44,093 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-28 20:56:44,095 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 112892 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-28 20:56:44,095 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1912): a1b1dbe7b803694909bcd4c878b269f4/info is initiating minor compaction (all files) 2023-07-28 20:56:44,095 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a1b1dbe7b803694909bcd4c878b269f4/info in TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:56:44,095 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/fa1e7c6eede4438eacb273f76fb724ed, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/470950ad08244694be33edb772ad150b, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/f514b4ea71b24fe79d870cd5d6b3a541] into tmpdir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp, totalSize=110.2 K 2023-07-28 20:56:44,096 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting fa1e7c6eede4438eacb273f76fb724ed, keycount=63, bloomtype=ROW, size=69.9 K, encoding=NONE, compression=NONE, seqNum=164, earliestPutTs=1690577767590 2023-07-28 20:56:44,096 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 470950ad08244694be33edb772ad150b, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=176, earliestPutTs=1690577791962 2023-07-28 20:56:44,096 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting f514b4ea71b24fe79d870cd5d6b3a541, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=201, earliestPutTs=1690577793977 2023-07-28 20:56:44,108 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] throttle.PressureAwareThroughputController(145): a1b1dbe7b803694909bcd4c878b269f4#info#compaction#35 average throughput is 46.61 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-28 20:56:44,125 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/1f241673da4d4d12a3c10be4c9c55b29 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1f241673da4d4d12a3c10be4c9c55b29 2023-07-28 20:56:44,131 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a1b1dbe7b803694909bcd4c878b269f4/info of a1b1dbe7b803694909bcd4c878b269f4 into 1f241673da4d4d12a3c10be4c9c55b29(size=100.9 K), total size for store is 100.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-28 20:56:44,131 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:44,131 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4., storeName=a1b1dbe7b803694909bcd4c878b269f4/info, priority=13, startTime=1690577804093; duration=0sec 2023-07-28 20:56:44,131 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:46,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:46,083 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing a1b1dbe7b803694909bcd4c878b269f4 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-28 20:56:46,110 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=213 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/cecf441ef3e742758f01b7f3225df840 2023-07-28 20:56:46,118 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/cecf441ef3e742758f01b7f3225df840 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/cecf441ef3e742758f01b7f3225df840 2023-07-28 20:56:46,127 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/cecf441ef3e742758f01b7f3225df840, entries=8, sequenceid=213, filesize=13.0 K 2023-07-28 20:56:46,129 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for a1b1dbe7b803694909bcd4c878b269f4 in 46ms, sequenceid=213, compaction requested=false 2023-07-28 20:56:46,129 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:46,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:46,130 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing a1b1dbe7b803694909bcd4c878b269f4 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-28 20:56:46,143 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=238 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/90d88c40e5c94b598e4b209347074179 2023-07-28 20:56:46,150 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/90d88c40e5c94b598e4b209347074179 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/90d88c40e5c94b598e4b209347074179 2023-07-28 20:56:46,155 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/90d88c40e5c94b598e4b209347074179, entries=22, sequenceid=238, filesize=27.4 K 2023-07-28 20:56:46,158 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=6.16 KB/6306 for a1b1dbe7b803694909bcd4c878b269f4 in 27ms, sequenceid=238, compaction requested=true 2023-07-28 20:56:46,158 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:46,158 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:46,158 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-28 20:56:46,160 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 144657 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-28 20:56:46,160 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1912): a1b1dbe7b803694909bcd4c878b269f4/info is initiating minor compaction (all files) 2023-07-28 20:56:46,160 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a1b1dbe7b803694909bcd4c878b269f4/info in TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:56:46,160 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1f241673da4d4d12a3c10be4c9c55b29, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/cecf441ef3e742758f01b7f3225df840, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/90d88c40e5c94b598e4b209347074179] into tmpdir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp, totalSize=141.3 K 2023-07-28 20:56:46,161 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 1f241673da4d4d12a3c10be4c9c55b29, keycount=93, bloomtype=ROW, size=100.9 K, encoding=NONE, compression=NONE, seqNum=201, earliestPutTs=1690577767590 2023-07-28 20:56:46,161 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting cecf441ef3e742758f01b7f3225df840, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=213, earliestPutTs=1690577804065 2023-07-28 20:56:46,162 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 90d88c40e5c94b598e4b209347074179, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=238, earliestPutTs=1690577806084 2023-07-28 20:56:46,177 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] throttle.PressureAwareThroughputController(145): a1b1dbe7b803694909bcd4c878b269f4#info#compaction#38 average throughput is 41.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-28 20:56:46,195 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/366ec7cabcb54f01962c83259b562691 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/366ec7cabcb54f01962c83259b562691 2023-07-28 20:56:46,205 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a1b1dbe7b803694909bcd4c878b269f4/info of a1b1dbe7b803694909bcd4c878b269f4 into 366ec7cabcb54f01962c83259b562691(size=132.0 K), total size for store is 132.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-28 20:56:46,205 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:46,206 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4., storeName=a1b1dbe7b803694909bcd4c878b269f4/info, priority=13, startTime=1690577806158; duration=0sec 2023-07-28 20:56:46,206 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:48,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:48,152 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing a1b1dbe7b803694909bcd4c878b269f4 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-28 20:56:48,207 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=250 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/1e4d606b7cf24a968e4a36ec82a2e623 2023-07-28 20:56:48,221 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/1e4d606b7cf24a968e4a36ec82a2e623 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1e4d606b7cf24a968e4a36ec82a2e623 2023-07-28 20:56:48,225 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=a1b1dbe7b803694909bcd4c878b269f4, server=jenkins-hbase17.apache.org,38479,1690577731496 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-28 20:56:48,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] ipc.CallRunner(144): callId: 236 service: ClientService methodName: Mutate size: 1.2 K connection: 136.243.18.41:50448 deadline: 1690577818224, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=a1b1dbe7b803694909bcd4c878b269f4, server=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:56:48,230 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1e4d606b7cf24a968e4a36ec82a2e623, entries=8, sequenceid=250, filesize=13.0 K 2023-07-28 20:56:48,232 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for a1b1dbe7b803694909bcd4c878b269f4 in 80ms, sequenceid=250, compaction requested=false 2023-07-28 20:56:48,232 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:58,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:56:58,330 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing a1b1dbe7b803694909bcd4c878b269f4 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-28 20:56:58,370 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=a1b1dbe7b803694909bcd4c878b269f4, server=jenkins-hbase17.apache.org,38479,1690577731496 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-28 20:56:58,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] ipc.CallRunner(144): callId: 246 service: ClientService methodName: Mutate size: 1.2 K connection: 136.243.18.41:50448 deadline: 1690577828370, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=a1b1dbe7b803694909bcd4c878b269f4, server=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:56:58,441 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=275 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/cd2217b0a0b74cff8475958c15b23ead 2023-07-28 20:56:58,468 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/cd2217b0a0b74cff8475958c15b23ead as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/cd2217b0a0b74cff8475958c15b23ead 2023-07-28 20:56:58,479 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/cd2217b0a0b74cff8475958c15b23ead, entries=22, sequenceid=275, filesize=27.4 K 2023-07-28 20:56:58,480 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=7.18 KB/7357 for a1b1dbe7b803694909bcd4c878b269f4 in 151ms, sequenceid=275, compaction requested=true 2023-07-28 20:56:58,480 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:58,480 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:56:58,480 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-28 20:56:58,483 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 176503 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-28 20:56:58,483 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1912): a1b1dbe7b803694909bcd4c878b269f4/info is initiating minor compaction (all files) 2023-07-28 20:56:58,483 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a1b1dbe7b803694909bcd4c878b269f4/info in TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:56:58,483 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/366ec7cabcb54f01962c83259b562691, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1e4d606b7cf24a968e4a36ec82a2e623, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/cd2217b0a0b74cff8475958c15b23ead] into tmpdir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp, totalSize=172.4 K 2023-07-28 20:56:58,484 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 366ec7cabcb54f01962c83259b562691, keycount=123, bloomtype=ROW, size=132.0 K, encoding=NONE, compression=NONE, seqNum=238, earliestPutTs=1690577767590 2023-07-28 20:56:58,484 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 1e4d606b7cf24a968e4a36ec82a2e623, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=250, earliestPutTs=1690577806131 2023-07-28 20:56:58,485 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting cd2217b0a0b74cff8475958c15b23ead, keycount=22, bloomtype=ROW, size=27.4 K, encoding=NONE, compression=NONE, seqNum=275, earliestPutTs=1690577808157 2023-07-28 20:56:58,513 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] throttle.PressureAwareThroughputController(145): a1b1dbe7b803694909bcd4c878b269f4#info#compaction#41 average throughput is 51.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-28 20:56:58,599 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/eaff744587ee426c93b89bafef09764d as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/eaff744587ee426c93b89bafef09764d 2023-07-28 20:56:58,627 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a1b1dbe7b803694909bcd4c878b269f4/info of a1b1dbe7b803694909bcd4c878b269f4 into eaff744587ee426c93b89bafef09764d(size=163.0 K), total size for store is 163.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-28 20:56:58,628 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:56:58,628 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4., storeName=a1b1dbe7b803694909bcd4c878b269f4/info, priority=13, startTime=1690577818480; duration=0sec 2023-07-28 20:56:58,628 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:57:08,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:57:08,405 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing a1b1dbe7b803694909bcd4c878b269f4 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-28 20:57:08,431 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=287 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/776b19ca5eff4887ae3c09754aaf7380 2023-07-28 20:57:08,439 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/776b19ca5eff4887ae3c09754aaf7380 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/776b19ca5eff4887ae3c09754aaf7380 2023-07-28 20:57:08,451 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/776b19ca5eff4887ae3c09754aaf7380, entries=8, sequenceid=287, filesize=13.0 K 2023-07-28 20:57:08,453 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=0 B/0 for a1b1dbe7b803694909bcd4c878b269f4 in 48ms, sequenceid=287, compaction requested=false 2023-07-28 20:57:08,453 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:57:10,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:57:10,425 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing a1b1dbe7b803694909bcd4c878b269f4 1/1 column families, dataSize=8.21 KB heapSize=9.06 KB 2023-07-28 20:57:10,460 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=8.21 KB at sequenceid=298 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/4727d7b368a346079d1519955965ca71 2023-07-28 20:57:10,480 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/4727d7b368a346079d1519955965ca71 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/4727d7b368a346079d1519955965ca71 2023-07-28 20:57:10,482 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(4965): Region is too busy due to exceeding memstore size limit. org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=a1b1dbe7b803694909bcd4c878b269f4, server=jenkins-hbase17.apache.org,38479,1690577731496 at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:4963) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3155) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-28 20:57:10,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] ipc.CallRunner(144): callId: 278 service: ClientService methodName: Mutate size: 1.2 K connection: 136.243.18.41:50448 deadline: 1690577840482, exception=org.apache.hadoop.hbase.RegionTooBusyException: Over memstore limit=32.0 K, regionName=a1b1dbe7b803694909bcd4c878b269f4, server=jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:57:10,486 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/4727d7b368a346079d1519955965ca71, entries=8, sequenceid=298, filesize=13.0 K 2023-07-28 20:57:10,488 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~8.21 KB/8408, heapSize ~9.05 KB/9264, currentSize=21.55 KB/22071 for a1b1dbe7b803694909bcd4c878b269f4 in 63ms, sequenceid=298, compaction requested=true 2023-07-28 20:57:10,488 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:57:10,488 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:57:10,488 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-28 20:57:10,490 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 193525 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-28 20:57:10,490 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1912): a1b1dbe7b803694909bcd4c878b269f4/info is initiating minor compaction (all files) 2023-07-28 20:57:10,490 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a1b1dbe7b803694909bcd4c878b269f4/info in TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:57:10,490 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/eaff744587ee426c93b89bafef09764d, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/776b19ca5eff4887ae3c09754aaf7380, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/4727d7b368a346079d1519955965ca71] into tmpdir=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp, totalSize=189.0 K 2023-07-28 20:57:10,491 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting eaff744587ee426c93b89bafef09764d, keycount=153, bloomtype=ROW, size=163.0 K, encoding=NONE, compression=NONE, seqNum=275, earliestPutTs=1690577767590 2023-07-28 20:57:10,491 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 776b19ca5eff4887ae3c09754aaf7380, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=287, earliestPutTs=1690577818332 2023-07-28 20:57:10,491 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] compactions.Compactor(207): Compacting 4727d7b368a346079d1519955965ca71, keycount=8, bloomtype=ROW, size=13.0 K, encoding=NONE, compression=NONE, seqNum=298, earliestPutTs=1690577830407 2023-07-28 20:57:10,528 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] throttle.PressureAwareThroughputController(145): a1b1dbe7b803694909bcd4c878b269f4#info#compaction#44 average throughput is 42.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-28 20:57:10,979 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/91a1cf940ea041209c434420237c867b as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/91a1cf940ea041209c434420237c867b 2023-07-28 20:57:10,993 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a1b1dbe7b803694909bcd4c878b269f4/info of a1b1dbe7b803694909bcd4c878b269f4 into 91a1cf940ea041209c434420237c867b(size=179.6 K), total size for store is 179.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-28 20:57:10,993 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:57:10,993 INFO [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4., storeName=a1b1dbe7b803694909bcd4c878b269f4/info, priority=13, startTime=1690577830488; duration=0sec 2023-07-28 20:57:10,993 DEBUG [RS:0;jenkins-hbase17:38479-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-28 20:57:20,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38479] regionserver.HRegion(9158): Flush requested on a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:57:20,562 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing a1b1dbe7b803694909bcd4c878b269f4 1/1 column families, dataSize=22.58 KB heapSize=24.48 KB 2023-07-28 20:57:20,580 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.58 KB at sequenceid=324 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/1de4e0e764c8412096e69b2b3e3ac4e3 2023-07-28 20:57:20,613 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/1de4e0e764c8412096e69b2b3e3ac4e3 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1de4e0e764c8412096e69b2b3e3ac4e3 2023-07-28 20:57:20,639 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1de4e0e764c8412096e69b2b3e3ac4e3, entries=22, sequenceid=324, filesize=27.4 K 2023-07-28 20:57:20,641 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~22.58 KB/23122, heapSize ~24.47 KB/25056, currentSize=2.05 KB/2102 for a1b1dbe7b803694909bcd4c878b269f4 in 79ms, sequenceid=324, compaction requested=false 2023-07-28 20:57:20,641 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:57:22,564 INFO [Listener at localhost.localdomain/45657] wal.AbstractTestLogRolling(188): after writing there are 0 log files 2023-07-28 20:57:22,601 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38249,DS-bca9652b-97c3-42a6-bdab-5041070a55bf,DISK] 2023-07-28 20:57:22,617 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40357,DS-563dead6-a2ab-4d7d-aef5-185aaeb43bfc,DISK] 2023-07-28 20:57:22,640 INFO [Listener at localhost.localdomain/45657] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496/jenkins-hbase17.apache.org%2C38479%2C1690577731496.1690577733518 with entries=311, filesize=301.18 KB; new WAL /user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496/jenkins-hbase17.apache.org%2C38479%2C1690577731496.1690577842565 2023-07-28 20:57:22,649 DEBUG [Listener at localhost.localdomain/45657] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38249,DS-bca9652b-97c3-42a6-bdab-5041070a55bf,DISK], DatanodeInfoWithStorage[127.0.0.1:40357,DS-563dead6-a2ab-4d7d-aef5-185aaeb43bfc,DISK]] 2023-07-28 20:57:22,649 DEBUG [Listener at localhost.localdomain/45657] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496/jenkins-hbase17.apache.org%2C38479%2C1690577731496.1690577733518 is not closed yet, will try archiving it next time 2023-07-28 20:57:22,656 INFO [Listener at localhost.localdomain/45657] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.26 KB heapSize=4.19 KB 2023-07-28 20:57:22,722 INFO [Listener at localhost.localdomain/45657] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.26 KB at sequenceid=24 (bloomFilter=false), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/.tmp/info/5f775dd6d2c045578596ddf24a41b06d 2023-07-28 20:57:22,737 DEBUG [Listener at localhost.localdomain/45657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/.tmp/info/5f775dd6d2c045578596ddf24a41b06d as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/info/5f775dd6d2c045578596ddf24a41b06d 2023-07-28 20:57:22,745 INFO [Listener at localhost.localdomain/45657] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/info/5f775dd6d2c045578596ddf24a41b06d, entries=16, sequenceid=24, filesize=7.0 K 2023-07-28 20:57:22,747 INFO [Listener at localhost.localdomain/45657] regionserver.HRegion(2948): Finished flush of dataSize ~2.26 KB/2316, heapSize ~3.67 KB/3760, currentSize=0 B/0 for 1588230740 in 91ms, sequenceid=24, compaction requested=false 2023-07-28 20:57:22,747 DEBUG [Listener at localhost.localdomain/45657] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-07-28 20:57:22,747 DEBUG [Listener at localhost.localdomain/45657] regionserver.HRegion(2446): Flush status journal for e2c4048b019097d3fb0f0accbf0c1005: 2023-07-28 20:57:22,747 INFO [Listener at localhost.localdomain/45657] regionserver.HRegion(2745): Flushing a1b1dbe7b803694909bcd4c878b269f4 1/1 column families, dataSize=2.05 KB heapSize=2.45 KB 2023-07-28 20:57:22,790 INFO [Listener at localhost.localdomain/45657] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.05 KB at sequenceid=329 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/00282f9927934662a10bd45d82e91959 2023-07-28 20:57:22,797 DEBUG [Listener at localhost.localdomain/45657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/.tmp/info/00282f9927934662a10bd45d82e91959 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/00282f9927934662a10bd45d82e91959 2023-07-28 20:57:22,803 INFO [Listener at localhost.localdomain/45657] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/00282f9927934662a10bd45d82e91959, entries=2, sequenceid=329, filesize=6.8 K 2023-07-28 20:57:22,804 INFO [Listener at localhost.localdomain/45657] regionserver.HRegion(2948): Finished flush of dataSize ~2.05 KB/2102, heapSize ~2.44 KB/2496, currentSize=0 B/0 for a1b1dbe7b803694909bcd4c878b269f4 in 57ms, sequenceid=329, compaction requested=true 2023-07-28 20:57:22,805 DEBUG [Listener at localhost.localdomain/45657] regionserver.HRegion(2446): Flush status journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:57:22,805 INFO [Listener at localhost.localdomain/45657] regionserver.HRegion(2745): Flushing 231e6ed31529ae2cdf24799142fe8de0 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-28 20:57:22,848 INFO [Listener at localhost.localdomain/45657] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0/.tmp/info/a2a5cefc2f934c33921385f5d2fc8702 2023-07-28 20:57:22,862 DEBUG [Listener at localhost.localdomain/45657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0/.tmp/info/a2a5cefc2f934c33921385f5d2fc8702 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0/info/a2a5cefc2f934c33921385f5d2fc8702 2023-07-28 20:57:22,894 INFO [Listener at localhost.localdomain/45657] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0/info/a2a5cefc2f934c33921385f5d2fc8702, entries=2, sequenceid=6, filesize=4.8 K 2023-07-28 20:57:22,897 INFO [Listener at localhost.localdomain/45657] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 231e6ed31529ae2cdf24799142fe8de0 in 92ms, sequenceid=6, compaction requested=false 2023-07-28 20:57:22,898 DEBUG [Listener at localhost.localdomain/45657] regionserver.HRegion(2446): Flush status journal for 231e6ed31529ae2cdf24799142fe8de0: 2023-07-28 20:57:22,947 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38249,DS-bca9652b-97c3-42a6-bdab-5041070a55bf,DISK] 2023-07-28 20:57:22,947 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40357,DS-563dead6-a2ab-4d7d-aef5-185aaeb43bfc,DISK] 2023-07-28 20:57:22,952 INFO [Listener at localhost.localdomain/45657] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496/jenkins-hbase17.apache.org%2C38479%2C1690577731496.1690577842565 with entries=4, filesize=1.22 KB; new WAL /user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496/jenkins-hbase17.apache.org%2C38479%2C1690577731496.1690577842898 2023-07-28 20:57:22,952 DEBUG [Listener at localhost.localdomain/45657] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40357,DS-563dead6-a2ab-4d7d-aef5-185aaeb43bfc,DISK], DatanodeInfoWithStorage[127.0.0.1:38249,DS-bca9652b-97c3-42a6-bdab-5041070a55bf,DISK]] 2023-07-28 20:57:22,952 DEBUG [Listener at localhost.localdomain/45657] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496/jenkins-hbase17.apache.org%2C38479%2C1690577731496.1690577842565 is not closed yet, will try archiving it next time 2023-07-28 20:57:22,955 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496/jenkins-hbase17.apache.org%2C38479%2C1690577731496.1690577733518 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/oldWALs/jenkins-hbase17.apache.org%2C38479%2C1690577731496.1690577733518 2023-07-28 20:57:22,956 INFO [Listener at localhost.localdomain/45657] hbase.Waiter(180): Waiting up to [5,000] milli-secs(wait.for.ratio=[1]) 2023-07-28 20:57:22,957 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/WALs/jenkins-hbase17.apache.org,38479,1690577731496/jenkins-hbase17.apache.org%2C38479%2C1690577731496.1690577842565 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/oldWALs/jenkins-hbase17.apache.org%2C38479%2C1690577731496.1690577842565 2023-07-28 20:57:23,056 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-28 20:57:23,056 INFO [Listener at localhost.localdomain/45657] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-28 20:57:23,056 DEBUG [Listener at localhost.localdomain/45657] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c6198c6 to 127.0.0.1:64180 2023-07-28 20:57:23,057 DEBUG [Listener at localhost.localdomain/45657] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:57:23,057 DEBUG [Listener at localhost.localdomain/45657] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-28 20:57:23,057 DEBUG [Listener at localhost.localdomain/45657] util.JVMClusterUtil(257): Found active master hash=972029750, stopped=false 2023-07-28 20:57:23,057 INFO [Listener at localhost.localdomain/45657] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,36349,1690577731307 2023-07-28 20:57:23,058 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): regionserver:38479-0x101adb679ad0001, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-28 20:57:23,058 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-28 20:57:23,058 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:23,058 INFO [Listener at localhost.localdomain/45657] procedure2.ProcedureExecutor(629): Stopping 2023-07-28 20:57:23,059 DEBUG [Listener at localhost.localdomain/45657] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fc59845 to 127.0.0.1:64180 2023-07-28 20:57:23,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:57:23,059 DEBUG [Listener at localhost.localdomain/45657] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:57:23,060 INFO [Listener at localhost.localdomain/45657] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,38479,1690577731496' ***** 2023-07-28 20:57:23,060 INFO [Listener at localhost.localdomain/45657] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-28 20:57:23,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38479-0x101adb679ad0001, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:57:23,061 INFO [RS:0;jenkins-hbase17:38479] regionserver.HeapMemoryManager(220): Stopping 2023-07-28 20:57:23,061 INFO [RS:0;jenkins-hbase17:38479] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-28 20:57:23,061 INFO [RS:0;jenkins-hbase17:38479] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-28 20:57:23,061 INFO [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(3305): Received CLOSE for e2c4048b019097d3fb0f0accbf0c1005 2023-07-28 20:57:23,062 INFO [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(3305): Received CLOSE for a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:57:23,062 INFO [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(3305): Received CLOSE for 231e6ed31529ae2cdf24799142fe8de0 2023-07-28 20:57:23,062 INFO [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:57:23,062 DEBUG [RS:0;jenkins-hbase17:38479] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09716513 to 127.0.0.1:64180 2023-07-28 20:57:23,062 DEBUG [RS:0;jenkins-hbase17:38479] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:57:23,062 INFO [RS:0;jenkins-hbase17:38479] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-28 20:57:23,062 INFO [RS:0;jenkins-hbase17:38479] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-28 20:57:23,062 INFO [RS:0;jenkins-hbase17:38479] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-28 20:57:23,062 INFO [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-28 20:57:23,061 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-28 20:57:23,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e2c4048b019097d3fb0f0accbf0c1005, disabling compactions & flushes 2023-07-28 20:57:23,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005. 2023-07-28 20:57:23,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005. 2023-07-28 20:57:23,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005. after waiting 0 ms 2023-07-28 20:57:23,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005. 2023-07-28 20:57:23,068 INFO [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-07-28 20:57:23,068 DEBUG [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, e2c4048b019097d3fb0f0accbf0c1005=TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005., a1b1dbe7b803694909bcd4c878b269f4=TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4., 231e6ed31529ae2cdf24799142fe8de0=hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0.} 2023-07-28 20:57:23,068 DEBUG [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1504): Waiting on 1588230740, 231e6ed31529ae2cdf24799142fe8de0, a1b1dbe7b803694909bcd4c878b269f4, e2c4048b019097d3fb0f0accbf0c1005 2023-07-28 20:57:23,069 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-28 20:57:23,069 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-28 20:57:23,069 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-28 20:57:23,069 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-28 20:57:23,069 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-28 20:57:23,078 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005/info/4fbbb6453b8943938d4ff81518e1385b.d2fba48c738898f36b7e77c73d6e87ee->hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4fbbb6453b8943938d4ff81518e1385b-bottom] to archive 2023-07-28 20:57:23,079 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-28 20:57:23,084 DEBUG [StoreCloser-TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005/info/4fbbb6453b8943938d4ff81518e1385b.d2fba48c738898f36b7e77c73d6e87ee to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005/info/4fbbb6453b8943938d4ff81518e1385b.d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:57:23,091 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/meta/1588230740/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-07-28 20:57:23,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-28 20:57:23,095 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-28 20:57:23,095 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-28 20:57:23,095 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-28 20:57:23,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/e2c4048b019097d3fb0f0accbf0c1005/recovered.edits/132.seqid, newMaxSeqId=132, maxSeqId=127 2023-07-28 20:57:23,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005. 2023-07-28 20:57:23,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e2c4048b019097d3fb0f0accbf0c1005: 2023-07-28 20:57:23,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,,1690577769741.e2c4048b019097d3fb0f0accbf0c1005. 2023-07-28 20:57:23,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a1b1dbe7b803694909bcd4c878b269f4, disabling compactions & flushes 2023-07-28 20:57:23,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:57:23,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:57:23,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. after waiting 0 ms 2023-07-28 20:57:23,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:57:23,128 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/4fbbb6453b8943938d4ff81518e1385b.d2fba48c738898f36b7e77c73d6e87ee->hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/d2fba48c738898f36b7e77c73d6e87ee/info/4fbbb6453b8943938d4ff81518e1385b-top, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/338cc046dfb048e5984abacff5926eeb, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/TestLogRolling-testLogRolling=d2fba48c738898f36b7e77c73d6e87ee-a19e38d94b8342d7978e2860becc6613, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/3ba7176b67c647d580df447966fe513e, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/fa1e7c6eede4438eacb273f76fb724ed, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/ba9804b4b8b040a4a41747e7d85ebd51, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/470950ad08244694be33edb772ad150b, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1f241673da4d4d12a3c10be4c9c55b29, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/f514b4ea71b24fe79d870cd5d6b3a541, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/cecf441ef3e742758f01b7f3225df840, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/366ec7cabcb54f01962c83259b562691, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/90d88c40e5c94b598e4b209347074179, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1e4d606b7cf24a968e4a36ec82a2e623, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/eaff744587ee426c93b89bafef09764d, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/cd2217b0a0b74cff8475958c15b23ead, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/776b19ca5eff4887ae3c09754aaf7380, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/4727d7b368a346079d1519955965ca71] to archive 2023-07-28 20:57:23,129 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-28 20:57:23,131 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/4fbbb6453b8943938d4ff81518e1385b.d2fba48c738898f36b7e77c73d6e87ee to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/4fbbb6453b8943938d4ff81518e1385b.d2fba48c738898f36b7e77c73d6e87ee 2023-07-28 20:57:23,136 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/338cc046dfb048e5984abacff5926eeb to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/338cc046dfb048e5984abacff5926eeb 2023-07-28 20:57:23,150 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/TestLogRolling-testLogRolling=d2fba48c738898f36b7e77c73d6e87ee-a19e38d94b8342d7978e2860becc6613 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/TestLogRolling-testLogRolling=d2fba48c738898f36b7e77c73d6e87ee-a19e38d94b8342d7978e2860becc6613 2023-07-28 20:57:23,156 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/3ba7176b67c647d580df447966fe513e to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/3ba7176b67c647d580df447966fe513e 2023-07-28 20:57:23,169 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/fa1e7c6eede4438eacb273f76fb724ed to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/fa1e7c6eede4438eacb273f76fb724ed 2023-07-28 20:57:23,174 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/ba9804b4b8b040a4a41747e7d85ebd51 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/ba9804b4b8b040a4a41747e7d85ebd51 2023-07-28 20:57:23,177 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/470950ad08244694be33edb772ad150b to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/470950ad08244694be33edb772ad150b 2023-07-28 20:57:23,182 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1f241673da4d4d12a3c10be4c9c55b29 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1f241673da4d4d12a3c10be4c9c55b29 2023-07-28 20:57:23,185 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/f514b4ea71b24fe79d870cd5d6b3a541 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/f514b4ea71b24fe79d870cd5d6b3a541 2023-07-28 20:57:23,203 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/cecf441ef3e742758f01b7f3225df840 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/cecf441ef3e742758f01b7f3225df840 2023-07-28 20:57:23,219 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/366ec7cabcb54f01962c83259b562691 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/366ec7cabcb54f01962c83259b562691 2023-07-28 20:57:23,224 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/90d88c40e5c94b598e4b209347074179 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/90d88c40e5c94b598e4b209347074179 2023-07-28 20:57:23,233 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1e4d606b7cf24a968e4a36ec82a2e623 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/1e4d606b7cf24a968e4a36ec82a2e623 2023-07-28 20:57:23,239 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/eaff744587ee426c93b89bafef09764d to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/eaff744587ee426c93b89bafef09764d 2023-07-28 20:57:23,240 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/cd2217b0a0b74cff8475958c15b23ead to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/cd2217b0a0b74cff8475958c15b23ead 2023-07-28 20:57:23,243 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/776b19ca5eff4887ae3c09754aaf7380 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/776b19ca5eff4887ae3c09754aaf7380 2023-07-28 20:57:23,245 DEBUG [StoreCloser-TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/4727d7b368a346079d1519955965ca71 to hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/archive/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/info/4727d7b368a346079d1519955965ca71 2023-07-28 20:57:23,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/default/TestLogRolling-testLogRolling/a1b1dbe7b803694909bcd4c878b269f4/recovered.edits/332.seqid, newMaxSeqId=332, maxSeqId=127 2023-07-28 20:57:23,269 DEBUG [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1504): Waiting on 231e6ed31529ae2cdf24799142fe8de0, a1b1dbe7b803694909bcd4c878b269f4 2023-07-28 20:57:23,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:57:23,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a1b1dbe7b803694909bcd4c878b269f4: 2023-07-28 20:57:23,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed TestLogRolling-testLogRolling,row0064,1690577769741.a1b1dbe7b803694909bcd4c878b269f4. 2023-07-28 20:57:23,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 231e6ed31529ae2cdf24799142fe8de0, disabling compactions & flushes 2023-07-28 20:57:23,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. 2023-07-28 20:57:23,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. 2023-07-28 20:57:23,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. after waiting 0 ms 2023-07-28 20:57:23,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. 2023-07-28 20:57:23,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/data/hbase/namespace/231e6ed31529ae2cdf24799142fe8de0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-28 20:57:23,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. 2023-07-28 20:57:23,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 231e6ed31529ae2cdf24799142fe8de0: 2023-07-28 20:57:23,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690577733876.231e6ed31529ae2cdf24799142fe8de0. 2023-07-28 20:57:23,345 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-28 20:57:23,363 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-28 20:57:23,364 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-28 20:57:23,474 INFO [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,38479,1690577731496; all regions closed. 2023-07-28 20:57:23,496 DEBUG [RS:0;jenkins-hbase17:38479] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/oldWALs 2023-07-28 20:57:23,496 INFO [RS:0;jenkins-hbase17:38479] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C38479%2C1690577731496.meta:.meta(num 1690577733749) 2023-07-28 20:57:23,514 DEBUG [RS:0;jenkins-hbase17:38479] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/oldWALs 2023-07-28 20:57:23,514 INFO [RS:0;jenkins-hbase17:38479] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C38479%2C1690577731496:(num 1690577842898) 2023-07-28 20:57:23,514 DEBUG [RS:0;jenkins-hbase17:38479] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:57:23,514 INFO [RS:0;jenkins-hbase17:38479] regionserver.LeaseManager(133): Closed leases 2023-07-28 20:57:23,515 INFO [RS:0;jenkins-hbase17:38479] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-28 20:57:23,515 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-28 20:57:23,516 INFO [RS:0;jenkins-hbase17:38479] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:38479 2023-07-28 20:57:23,518 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-28 20:57:23,518 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): regionserver:38479-0x101adb679ad0001, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,38479,1690577731496 2023-07-28 20:57:23,518 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): regionserver:38479-0x101adb679ad0001, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-28 20:57:23,524 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,38479,1690577731496] 2023-07-28 20:57:23,524 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,38479,1690577731496; numProcessing=1 2023-07-28 20:57:23,525 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,38479,1690577731496 already deleted, retry=false 2023-07-28 20:57:23,525 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,38479,1690577731496 expired; onlineServers=0 2023-07-28 20:57:23,525 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,36349,1690577731307' ***** 2023-07-28 20:57:23,525 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-28 20:57:23,526 DEBUG [M:0;jenkins-hbase17:36349] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dd06cd3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-28 20:57:23,526 INFO [M:0;jenkins-hbase17:36349] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,36349,1690577731307 2023-07-28 20:57:23,526 INFO [M:0;jenkins-hbase17:36349] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,36349,1690577731307; all regions closed. 2023-07-28 20:57:23,526 DEBUG [M:0;jenkins-hbase17:36349] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:57:23,526 DEBUG [M:0;jenkins-hbase17:36349] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-28 20:57:23,526 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-28 20:57:23,526 DEBUG [M:0;jenkins-hbase17:36349] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-28 20:57:23,527 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690577733068] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690577733068,5,FailOnTimeoutGroup] 2023-07-28 20:57:23,527 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690577733067] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690577733067,5,FailOnTimeoutGroup] 2023-07-28 20:57:23,527 INFO [M:0;jenkins-hbase17:36349] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-28 20:57:23,528 INFO [M:0;jenkins-hbase17:36349] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-28 20:57:23,528 INFO [M:0;jenkins-hbase17:36349] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-28 20:57:23,529 DEBUG [M:0;jenkins-hbase17:36349] master.HMaster(1512): Stopping service threads 2023-07-28 20:57:23,529 INFO [M:0;jenkins-hbase17:36349] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-28 20:57:23,529 ERROR [M:0;jenkins-hbase17:36349] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-28 20:57:23,529 INFO [M:0;jenkins-hbase17:36349] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-28 20:57:23,529 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-28 20:57:23,530 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-28 20:57:23,530 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:23,530 DEBUG [M:0;jenkins-hbase17:36349] zookeeper.ZKUtil(398): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-28 20:57:23,530 WARN [M:0;jenkins-hbase17:36349] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-28 20:57:23,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-28 20:57:23,530 INFO [M:0;jenkins-hbase17:36349] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-28 20:57:23,531 INFO [M:0;jenkins-hbase17:36349] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-28 20:57:23,531 DEBUG [M:0;jenkins-hbase17:36349] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-28 20:57:23,532 INFO [M:0;jenkins-hbase17:36349] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:57:23,532 DEBUG [M:0;jenkins-hbase17:36349] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:57:23,532 DEBUG [M:0;jenkins-hbase17:36349] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-28 20:57:23,532 DEBUG [M:0;jenkins-hbase17:36349] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:57:23,532 INFO [M:0;jenkins-hbase17:36349] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=64.79 KB heapSize=78.54 KB 2023-07-28 20:57:23,572 INFO [M:0;jenkins-hbase17:36349] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64.79 KB at sequenceid=160 (bloomFilter=true), to=hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b4929c6527334922972b3432a322f198 2023-07-28 20:57:23,596 INFO [M:0;jenkins-hbase17:36349] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4929c6527334922972b3432a322f198 2023-07-28 20:57:23,598 DEBUG [M:0;jenkins-hbase17:36349] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b4929c6527334922972b3432a322f198 as hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b4929c6527334922972b3432a322f198 2023-07-28 20:57:23,611 INFO [M:0;jenkins-hbase17:36349] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4929c6527334922972b3432a322f198 2023-07-28 20:57:23,612 INFO [M:0;jenkins-hbase17:36349] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37579/user/jenkins/test-data/6f96ae6e-5807-a4db-cf17-c8ad1ca712c8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b4929c6527334922972b3432a322f198, entries=18, sequenceid=160, filesize=6.9 K 2023-07-28 20:57:23,613 INFO [M:0;jenkins-hbase17:36349] regionserver.HRegion(2948): Finished flush of dataSize ~64.79 KB/66340, heapSize ~78.52 KB/80408, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 81ms, sequenceid=160, compaction requested=false 2023-07-28 20:57:23,621 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): regionserver:38479-0x101adb679ad0001, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:57:23,622 INFO [RS:0;jenkins-hbase17:38479] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,38479,1690577731496; zookeeper connection closed. 2023-07-28 20:57:23,622 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): regionserver:38479-0x101adb679ad0001, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:57:23,628 INFO [M:0;jenkins-hbase17:36349] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:57:23,628 DEBUG [M:0;jenkins-hbase17:36349] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-28 20:57:23,631 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1848e2b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1848e2b 2023-07-28 20:57:23,631 INFO [Listener at localhost.localdomain/45657] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-28 20:57:23,661 INFO [M:0;jenkins-hbase17:36349] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-28 20:57:23,662 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-28 20:57:23,663 INFO [M:0;jenkins-hbase17:36349] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:36349 2023-07-28 20:57:23,671 DEBUG [M:0;jenkins-hbase17:36349] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,36349,1690577731307 already deleted, retry=false 2023-07-28 20:57:23,774 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:57:23,774 DEBUG [Listener at localhost.localdomain/45657-EventThread] zookeeper.ZKWatcher(600): master:36349-0x101adb679ad0000, quorum=127.0.0.1:64180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:57:23,774 INFO [M:0;jenkins-hbase17:36349] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,36349,1690577731307; zookeeper connection closed. 2023-07-28 20:57:23,775 WARN [Listener at localhost.localdomain/45657] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-28 20:57:23,816 INFO [Listener at localhost.localdomain/45657] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-28 20:57:23,830 WARN [BP-288482815-136.243.18.41-1690577730244 heartbeating to localhost.localdomain/127.0.0.1:37579] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-28 20:57:23,830 WARN [BP-288482815-136.243.18.41-1690577730244 heartbeating to localhost.localdomain/127.0.0.1:37579] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-288482815-136.243.18.41-1690577730244 (Datanode Uuid 16cb2051-6b36-4a26-9740-a0ebda435ceb) service to localhost.localdomain/127.0.0.1:37579 2023-07-28 20:57:23,831 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/cluster_eff16c4d-ebbe-35b6-7a5d-b1c176394bce/dfs/data/data4/current/BP-288482815-136.243.18.41-1690577730244] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:57:23,832 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/cluster_eff16c4d-ebbe-35b6-7a5d-b1c176394bce/dfs/data/data3/current/BP-288482815-136.243.18.41-1690577730244] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:57:23,833 WARN [Listener at localhost.localdomain/45657] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-28 20:57:23,877 INFO [Listener at localhost.localdomain/45657] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-28 20:57:24,003 WARN [BP-288482815-136.243.18.41-1690577730244 heartbeating to localhost.localdomain/127.0.0.1:37579] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-28 20:57:24,003 WARN [BP-288482815-136.243.18.41-1690577730244 heartbeating to localhost.localdomain/127.0.0.1:37579] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-288482815-136.243.18.41-1690577730244 (Datanode Uuid df103c06-3350-4702-9ae7-bad8f80ac0d5) service to localhost.localdomain/127.0.0.1:37579 2023-07-28 20:57:24,004 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/cluster_eff16c4d-ebbe-35b6-7a5d-b1c176394bce/dfs/data/data1/current/BP-288482815-136.243.18.41-1690577730244] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:57:24,004 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/cluster_eff16c4d-ebbe-35b6-7a5d-b1c176394bce/dfs/data/data2/current/BP-288482815-136.243.18.41-1690577730244] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:57:24,066 INFO [Listener at localhost.localdomain/45657] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-28 20:57:24,118 INFO [Listener at localhost.localdomain/45657] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-28 20:57:24,198 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-28 20:57:24,229 INFO [Listener at localhost.localdomain/45657] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRolling Thread=75 (was 64) - Thread LEAK? -, OpenFileDescriptor=460 (was 435) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=873 (was 991), ProcessCount=190 (was 193), AvailableMemoryMB=1198 (was 1186) - AvailableMemoryMB LEAK? - 2023-07-28 20:57:24,250 INFO [Listener at localhost.localdomain/45657] hbase.ResourceChecker(147): before: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=76, OpenFileDescriptor=462, MaxFileDescriptor=60000, SystemLoadAverage=873, ProcessCount=190, AvailableMemoryMB=1199 2023-07-28 20:57:24,250 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-28 20:57:24,250 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/hadoop.log.dir so I do NOT create it in target/test-data/8fa59fa2-66b1-a920-0247-455346830094 2023-07-28 20:57:24,251 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6ec2d3d9-fac7-147f-97c4-53896d052862/hadoop.tmp.dir so I do NOT create it in target/test-data/8fa59fa2-66b1-a920-0247-455346830094 2023-07-28 20:57:24,251 INFO [Listener at localhost.localdomain/45657] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/cluster_f5ab5092-ac61-904a-3463-5e5dcb2292e6, deleteOnExit=true 2023-07-28 20:57:24,251 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-28 20:57:24,251 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/test.cache.data in system properties and HBase conf 2023-07-28 20:57:24,251 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/hadoop.tmp.dir in system properties and HBase conf 2023-07-28 20:57:24,252 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/hadoop.log.dir in system properties and HBase conf 2023-07-28 20:57:24,252 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-28 20:57:24,253 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-28 20:57:24,253 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-28 20:57:24,253 DEBUG [Listener at localhost.localdomain/45657] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-28 20:57:24,254 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-28 20:57:24,254 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-28 20:57:24,254 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-28 20:57:24,254 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-28 20:57:24,255 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-28 20:57:24,255 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-28 20:57:24,255 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-28 20:57:24,255 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-28 20:57:24,255 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-28 20:57:24,255 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/nfs.dump.dir in system properties and HBase conf 2023-07-28 20:57:24,256 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/java.io.tmpdir in system properties and HBase conf 2023-07-28 20:57:24,256 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-28 20:57:24,256 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-28 20:57:24,256 INFO [Listener at localhost.localdomain/45657] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-28 20:57:24,260 WARN [Listener at localhost.localdomain/45657] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-28 20:57:24,260 WARN [Listener at localhost.localdomain/45657] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-28 20:57:24,304 WARN [Listener at localhost.localdomain/45657] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:57:24,309 INFO [Listener at localhost.localdomain/45657] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:57:24,318 INFO [Listener at localhost.localdomain/45657] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/java.io.tmpdir/Jetty_localhost_localdomain_44187_hdfs____2tqg5m/webapp 2023-07-28 20:57:24,440 INFO [Listener at localhost.localdomain/45657] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:44187 2023-07-28 20:57:24,444 WARN [Listener at localhost.localdomain/45657] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-28 20:57:24,444 WARN [Listener at localhost.localdomain/45657] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-28 20:57:24,521 WARN [Listener at localhost.localdomain/44719] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:57:24,563 WARN [Listener at localhost.localdomain/44719] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-28 20:57:24,567 WARN [Listener at localhost.localdomain/44719] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:57:24,569 INFO [Listener at localhost.localdomain/44719] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:57:24,585 INFO [Listener at localhost.localdomain/44719] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/java.io.tmpdir/Jetty_localhost_39561_datanode____.fl7ekv/webapp 2023-07-28 20:57:24,702 INFO [Listener at localhost.localdomain/44719] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39561 2023-07-28 20:57:24,715 WARN [Listener at localhost.localdomain/44917] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:57:24,781 WARN [Listener at localhost.localdomain/44917] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-28 20:57:24,787 WARN [Listener at localhost.localdomain/44917] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-28 20:57:24,789 INFO [Listener at localhost.localdomain/44917] log.Slf4jLog(67): jetty-6.1.26 2023-07-28 20:57:24,807 INFO [Listener at localhost.localdomain/44917] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/java.io.tmpdir/Jetty_localhost_32983_datanode____.p8unhg/webapp 2023-07-28 20:57:24,870 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x71c4a0721588f9eb: Processing first storage report for DS-036678c1-273d-4bee-a2d1-57f5a3dbe38b from datanode 289a83e7-4e0e-44d9-9b11-a9cfecfeacce 2023-07-28 20:57:24,870 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x71c4a0721588f9eb: from storage DS-036678c1-273d-4bee-a2d1-57f5a3dbe38b node DatanodeRegistration(127.0.0.1:39459, datanodeUuid=289a83e7-4e0e-44d9-9b11-a9cfecfeacce, infoPort=42377, infoSecurePort=0, ipcPort=44917, storageInfo=lv=-57;cid=testClusterID;nsid=1500162312;c=1690577844262), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-28 20:57:24,870 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x71c4a0721588f9eb: Processing first storage report for DS-68130bcd-7773-4391-a4a2-2a581b4e26cf from datanode 289a83e7-4e0e-44d9-9b11-a9cfecfeacce 2023-07-28 20:57:24,870 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x71c4a0721588f9eb: from storage DS-68130bcd-7773-4391-a4a2-2a581b4e26cf node DatanodeRegistration(127.0.0.1:39459, datanodeUuid=289a83e7-4e0e-44d9-9b11-a9cfecfeacce, infoPort=42377, infoSecurePort=0, ipcPort=44917, storageInfo=lv=-57;cid=testClusterID;nsid=1500162312;c=1690577844262), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:57:24,936 INFO [Listener at localhost.localdomain/44917] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32983 2023-07-28 20:57:24,954 WARN [Listener at localhost.localdomain/33897] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-28 20:57:25,062 DEBUG [Listener at localhost.localdomain/33897] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094 2023-07-28 20:57:25,063 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xae8a0a2e55c96e68: Processing first storage report for DS-552ce744-d076-466f-89c9-3420ccc9fb68 from datanode 627ffccb-5761-4eaa-af0f-3c680fefce6a 2023-07-28 20:57:25,064 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae8a0a2e55c96e68: from storage DS-552ce744-d076-466f-89c9-3420ccc9fb68 node DatanodeRegistration(127.0.0.1:37805, datanodeUuid=627ffccb-5761-4eaa-af0f-3c680fefce6a, infoPort=42767, infoSecurePort=0, ipcPort=33897, storageInfo=lv=-57;cid=testClusterID;nsid=1500162312;c=1690577844262), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-28 20:57:25,074 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xae8a0a2e55c96e68: Processing first storage report for DS-08cf74d7-50ee-4c7e-995b-81be85ddd8c8 from datanode 627ffccb-5761-4eaa-af0f-3c680fefce6a 2023-07-28 20:57:25,074 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae8a0a2e55c96e68: from storage DS-08cf74d7-50ee-4c7e-995b-81be85ddd8c8 node DatanodeRegistration(127.0.0.1:37805, datanodeUuid=627ffccb-5761-4eaa-af0f-3c680fefce6a, infoPort=42767, infoSecurePort=0, ipcPort=33897, storageInfo=lv=-57;cid=testClusterID;nsid=1500162312;c=1690577844262), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-28 20:57:25,085 INFO [Listener at localhost.localdomain/33897] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/cluster_f5ab5092-ac61-904a-3463-5e5dcb2292e6/zookeeper_0, clientPort=51130, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/cluster_f5ab5092-ac61-904a-3463-5e5dcb2292e6/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/cluster_f5ab5092-ac61-904a-3463-5e5dcb2292e6/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-28 20:57:25,088 INFO [Listener at localhost.localdomain/33897] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51130 2023-07-28 20:57:25,088 INFO [Listener at localhost.localdomain/33897] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:57:25,090 INFO [Listener at localhost.localdomain/33897] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:57:25,195 INFO [Listener at localhost.localdomain/33897] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212 with version=8 2023-07-28 20:57:25,195 INFO [Listener at localhost.localdomain/33897] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost.localdomain:44723/user/jenkins/test-data/93e0b733-22a7-6be2-e852-404820d75dc3/hbase-staging 2023-07-28 20:57:25,198 INFO [Listener at localhost.localdomain/33897] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-28 20:57:25,198 INFO [Listener at localhost.localdomain/33897] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:57:25,198 INFO [Listener at localhost.localdomain/33897] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-28 20:57:25,198 INFO [Listener at localhost.localdomain/33897] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-28 20:57:25,199 INFO [Listener at localhost.localdomain/33897] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:57:25,199 INFO [Listener at localhost.localdomain/33897] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-28 20:57:25,207 INFO [Listener at localhost.localdomain/33897] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-28 20:57:25,210 INFO [Listener at localhost.localdomain/33897] ipc.NettyRpcServer(120): Bind to /136.243.18.41:33529 2023-07-28 20:57:25,211 INFO [Listener at localhost.localdomain/33897] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:57:25,213 INFO [Listener at localhost.localdomain/33897] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:57:25,214 INFO [Listener at localhost.localdomain/33897] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33529 connecting to ZooKeeper ensemble=127.0.0.1:51130 2023-07-28 20:57:25,233 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:335290x0, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-28 20:57:25,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33529-0x101adb836670000 connected 2023-07-28 20:57:25,295 DEBUG [Listener at localhost.localdomain/33897] zookeeper.ZKUtil(164): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-28 20:57:25,297 DEBUG [Listener at localhost.localdomain/33897] zookeeper.ZKUtil(164): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:57:25,304 DEBUG [Listener at localhost.localdomain/33897] zookeeper.ZKUtil(164): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-28 20:57:25,310 DEBUG [Listener at localhost.localdomain/33897] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33529 2023-07-28 20:57:25,312 DEBUG [Listener at localhost.localdomain/33897] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33529 2023-07-28 20:57:25,317 DEBUG [Listener at localhost.localdomain/33897] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33529 2023-07-28 20:57:25,325 DEBUG [Listener at localhost.localdomain/33897] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33529 2023-07-28 20:57:25,325 DEBUG [Listener at localhost.localdomain/33897] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33529 2023-07-28 20:57:25,325 INFO [Listener at localhost.localdomain/33897] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212, hbase.cluster.distributed=false 2023-07-28 20:57:25,354 INFO [Listener at localhost.localdomain/33897] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-28 20:57:25,355 INFO [Listener at localhost.localdomain/33897] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:57:25,355 INFO [Listener at localhost.localdomain/33897] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-28 20:57:25,355 INFO [Listener at localhost.localdomain/33897] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-28 20:57:25,355 INFO [Listener at localhost.localdomain/33897] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-28 20:57:25,355 INFO [Listener at localhost.localdomain/33897] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-28 20:57:25,356 INFO [Listener at localhost.localdomain/33897] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-28 20:57:25,376 INFO [Listener at localhost.localdomain/33897] ipc.NettyRpcServer(120): Bind to /136.243.18.41:33673 2023-07-28 20:57:25,377 INFO [Listener at localhost.localdomain/33897] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-28 20:57:25,408 DEBUG [Listener at localhost.localdomain/33897] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-28 20:57:25,409 INFO [Listener at localhost.localdomain/33897] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:57:25,411 INFO [Listener at localhost.localdomain/33897] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:57:25,420 INFO [Listener at localhost.localdomain/33897] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33673 connecting to ZooKeeper ensemble=127.0.0.1:51130 2023-07-28 20:57:25,433 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): regionserver:336730x0, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-28 20:57:25,435 DEBUG [Listener at localhost.localdomain/33897] zookeeper.ZKUtil(164): regionserver:336730x0, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-28 20:57:25,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33673-0x101adb836670001 connected 2023-07-28 20:57:25,452 DEBUG [Listener at localhost.localdomain/33897] zookeeper.ZKUtil(164): regionserver:33673-0x101adb836670001, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:57:25,460 DEBUG [Listener at localhost.localdomain/33897] zookeeper.ZKUtil(164): regionserver:33673-0x101adb836670001, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-28 20:57:25,470 DEBUG [Listener at localhost.localdomain/33897] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33673 2023-07-28 20:57:25,471 DEBUG [Listener at localhost.localdomain/33897] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33673 2023-07-28 20:57:25,472 DEBUG [Listener at localhost.localdomain/33897] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33673 2023-07-28 20:57:25,485 DEBUG [Listener at localhost.localdomain/33897] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33673 2023-07-28 20:57:25,494 DEBUG [Listener at localhost.localdomain/33897] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33673 2023-07-28 20:57:25,505 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,33529,1690577845197 2023-07-28 20:57:25,513 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-28 20:57:25,513 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,33529,1690577845197 2023-07-28 20:57:25,514 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-28 20:57:25,514 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:25,515 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-28 20:57:25,515 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,33529,1690577845197 from backup master directory 2023-07-28 20:57:25,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-28 20:57:25,516 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): regionserver:33673-0x101adb836670001, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-28 20:57:25,516 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-28 20:57:25,516 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,33529,1690577845197 2023-07-28 20:57:25,516 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,33529,1690577845197 2023-07-28 20:57:25,516 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-28 20:57:26,016 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/hbase.id with ID: 540db661-c831-4d43-b940-341039957a48 2023-07-28 20:57:26,030 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:57:26,033 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:26,053 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0b7612df to 127.0.0.1:51130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-28 20:57:26,063 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4306c5b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-28 20:57:26,063 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-28 20:57:26,064 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-28 20:57:26,068 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:57:26,070 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/data/master/store-tmp 2023-07-28 20:57:26,092 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:57:26,092 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-28 20:57:26,092 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:57:26,092 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:57:26,092 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-28 20:57:26,092 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:57:26,092 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:57:26,092 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-28 20:57:26,094 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/WALs/jenkins-hbase17.apache.org,33529,1690577845197 2023-07-28 20:57:26,097 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C33529%2C1690577845197, suffix=, logDir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/WALs/jenkins-hbase17.apache.org,33529,1690577845197, archiveDir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/oldWALs, maxLogs=10 2023-07-28 20:57:26,118 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37805,DS-552ce744-d076-466f-89c9-3420ccc9fb68,DISK] 2023-07-28 20:57:26,118 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39459,DS-036678c1-273d-4bee-a2d1-57f5a3dbe38b,DISK] 2023-07-28 20:57:26,128 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/WALs/jenkins-hbase17.apache.org,33529,1690577845197/jenkins-hbase17.apache.org%2C33529%2C1690577845197.1690577846097 2023-07-28 20:57:26,128 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37805,DS-552ce744-d076-466f-89c9-3420ccc9fb68,DISK], DatanodeInfoWithStorage[127.0.0.1:39459,DS-036678c1-273d-4bee-a2d1-57f5a3dbe38b,DISK]] 2023-07-28 20:57:26,128 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:57:26,129 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:57:26,129 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:57:26,129 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:57:26,136 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:57:26,138 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-28 20:57:26,139 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-28 20:57:26,140 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:57:26,141 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:57:26,144 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:57:26,148 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-28 20:57:26,152 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:57:26,153 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=850346, jitterRate=0.081271231174469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:57:26,153 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-28 20:57:26,153 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-28 20:57:26,155 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-28 20:57:26,155 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-28 20:57:26,155 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-28 20:57:26,155 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-28 20:57:26,156 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-28 20:57:26,156 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-28 20:57:26,165 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-28 20:57:26,166 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-28 20:57:26,176 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-28 20:57:26,177 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-28 20:57:26,177 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-28 20:57:26,178 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-28 20:57:26,178 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-28 20:57:26,180 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:26,181 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-28 20:57:26,181 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-28 20:57:26,183 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-28 20:57:26,184 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-28 20:57:26,184 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:26,184 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): regionserver:33673-0x101adb836670001, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-28 20:57:26,184 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,33529,1690577845197, sessionid=0x101adb836670000, setting cluster-up flag (Was=false) 2023-07-28 20:57:26,190 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:26,195 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-28 20:57:26,196 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,33529,1690577845197 2023-07-28 20:57:26,201 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:26,228 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-28 20:57:26,246 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,33529,1690577845197 2023-07-28 20:57:26,247 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/.hbase-snapshot/.tmp 2023-07-28 20:57:26,266 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-28 20:57:26,266 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:57:26,266 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:57:26,266 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:57:26,267 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-28 20:57:26,267 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-28 20:57:26,267 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:57:26,267 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-28 20:57:26,267 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:57:26,280 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690577876280 2023-07-28 20:57:26,280 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-28 20:57:26,281 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-28 20:57:26,281 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-28 20:57:26,281 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-28 20:57:26,281 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-28 20:57:26,281 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-28 20:57:26,284 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:26,288 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-28 20:57:26,289 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-28 20:57:26,289 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-28 20:57:26,290 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-28 20:57:26,290 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-28 20:57:26,291 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690577846290,5,FailOnTimeoutGroup] 2023-07-28 20:57:26,292 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690577846291,5,FailOnTimeoutGroup] 2023-07-28 20:57:26,293 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:26,293 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-28 20:57:26,293 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:26,293 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:26,305 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-28 20:57:26,306 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-28 20:57:26,317 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-28 20:57:26,321 INFO [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(951): ClusterId : 540db661-c831-4d43-b940-341039957a48 2023-07-28 20:57:26,321 DEBUG [RS:0;jenkins-hbase17:33673] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-28 20:57:26,330 DEBUG [RS:0;jenkins-hbase17:33673] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-28 20:57:26,330 DEBUG [RS:0;jenkins-hbase17:33673] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-28 20:57:26,359 DEBUG [RS:0;jenkins-hbase17:33673] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-28 20:57:26,369 DEBUG [RS:0;jenkins-hbase17:33673] zookeeper.ReadOnlyZKClient(139): Connect 0x5cdb76cf to 127.0.0.1:51130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-28 20:57:26,404 DEBUG [RS:0;jenkins-hbase17:33673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@521c9324, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-28 20:57:26,405 DEBUG [RS:0;jenkins-hbase17:33673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56231dbf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-28 20:57:26,421 DEBUG [RS:0;jenkins-hbase17:33673] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:33673 2023-07-28 20:57:26,421 INFO [RS:0;jenkins-hbase17:33673] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-28 20:57:26,421 INFO [RS:0;jenkins-hbase17:33673] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-28 20:57:26,421 DEBUG [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1022): About to register with Master. 2023-07-28 20:57:26,423 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-28 20:57:26,427 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-28 20:57:26,427 INFO [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,33529,1690577845197 with isa=jenkins-hbase17.apache.org/136.243.18.41:33673, startcode=1690577845354 2023-07-28 20:57:26,427 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212 2023-07-28 20:57:26,427 DEBUG [RS:0;jenkins-hbase17:33673] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-28 20:57:26,439 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46711, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-07-28 20:57:26,443 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33529] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,33673,1690577845354 2023-07-28 20:57:26,443 DEBUG [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212 2023-07-28 20:57:26,444 DEBUG [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:44719 2023-07-28 20:57:26,444 DEBUG [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-28 20:57:26,446 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-28 20:57:26,449 DEBUG [RS:0;jenkins-hbase17:33673] zookeeper.ZKUtil(162): regionserver:33673-0x101adb836670001, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,33673,1690577845354 2023-07-28 20:57:26,450 WARN [RS:0;jenkins-hbase17:33673] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-28 20:57:26,450 INFO [RS:0;jenkins-hbase17:33673] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:57:26,450 DEBUG [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/WALs/jenkins-hbase17.apache.org,33673,1690577845354 2023-07-28 20:57:26,460 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,33673,1690577845354] 2023-07-28 20:57:26,486 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:57:26,494 DEBUG [RS:0;jenkins-hbase17:33673] zookeeper.ZKUtil(162): regionserver:33673-0x101adb836670001, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,33673,1690577845354 2023-07-28 20:57:26,495 DEBUG [RS:0;jenkins-hbase17:33673] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-28 20:57:26,495 INFO [RS:0;jenkins-hbase17:33673] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-28 20:57:26,500 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-28 20:57:26,501 INFO [RS:0;jenkins-hbase17:33673] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-28 20:57:26,506 INFO [RS:0;jenkins-hbase17:33673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-28 20:57:26,506 INFO [RS:0;jenkins-hbase17:33673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:26,507 INFO [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-28 20:57:26,520 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/info 2023-07-28 20:57:26,520 INFO [RS:0;jenkins-hbase17:33673] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:26,521 DEBUG [RS:0;jenkins-hbase17:33673] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:57:26,521 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-28 20:57:26,521 DEBUG [RS:0;jenkins-hbase17:33673] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:57:26,524 DEBUG [RS:0;jenkins-hbase17:33673] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:57:26,524 DEBUG [RS:0;jenkins-hbase17:33673] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:57:26,525 DEBUG [RS:0;jenkins-hbase17:33673] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:57:26,525 DEBUG [RS:0;jenkins-hbase17:33673] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-28 20:57:26,525 DEBUG [RS:0;jenkins-hbase17:33673] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:57:26,525 DEBUG [RS:0;jenkins-hbase17:33673] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:57:26,525 DEBUG [RS:0;jenkins-hbase17:33673] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:57:26,525 DEBUG [RS:0;jenkins-hbase17:33673] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-28 20:57:26,527 INFO [RS:0;jenkins-hbase17:33673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:26,528 INFO [RS:0;jenkins-hbase17:33673] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:26,528 INFO [RS:0;jenkins-hbase17:33673] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:26,531 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:57:26,552 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-28 20:57:26,554 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/rep_barrier 2023-07-28 20:57:26,555 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-28 20:57:26,556 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:57:26,557 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-28 20:57:26,562 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/table 2023-07-28 20:57:26,563 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-28 20:57:26,565 INFO [RS:0;jenkins-hbase17:33673] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-28 20:57:26,567 INFO [RS:0;jenkins-hbase17:33673] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,33673,1690577845354-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:26,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:57:26,589 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740 2023-07-28 20:57:26,601 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740 2023-07-28 20:57:26,603 INFO [RS:0;jenkins-hbase17:33673] regionserver.Replication(203): jenkins-hbase17.apache.org,33673,1690577845354 started 2023-07-28 20:57:26,604 INFO [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,33673,1690577845354, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:33673, sessionid=0x101adb836670001 2023-07-28 20:57:26,604 DEBUG [RS:0;jenkins-hbase17:33673] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-28 20:57:26,604 DEBUG [RS:0;jenkins-hbase17:33673] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,33673,1690577845354 2023-07-28 20:57:26,604 DEBUG [RS:0;jenkins-hbase17:33673] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,33673,1690577845354' 2023-07-28 20:57:26,604 DEBUG [RS:0;jenkins-hbase17:33673] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-28 20:57:26,605 DEBUG [RS:0;jenkins-hbase17:33673] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-28 20:57:26,606 DEBUG [RS:0;jenkins-hbase17:33673] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-28 20:57:26,606 DEBUG [RS:0;jenkins-hbase17:33673] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-28 20:57:26,606 DEBUG [RS:0;jenkins-hbase17:33673] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,33673,1690577845354 2023-07-28 20:57:26,606 DEBUG [RS:0;jenkins-hbase17:33673] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,33673,1690577845354' 2023-07-28 20:57:26,606 DEBUG [RS:0;jenkins-hbase17:33673] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-28 20:57:26,607 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-28 20:57:26,608 DEBUG [RS:0;jenkins-hbase17:33673] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-28 20:57:26,609 DEBUG [RS:0;jenkins-hbase17:33673] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-28 20:57:26,609 INFO [RS:0;jenkins-hbase17:33673] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-28 20:57:26,609 INFO [RS:0;jenkins-hbase17:33673] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-28 20:57:26,609 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-28 20:57:26,612 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:57:26,612 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=711827, jitterRate=-0.09486640989780426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-28 20:57:26,613 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-28 20:57:26,613 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-28 20:57:26,613 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-28 20:57:26,613 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-28 20:57:26,613 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-28 20:57:26,613 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-28 20:57:26,613 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-28 20:57:26,613 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-28 20:57:26,619 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-28 20:57:26,619 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-28 20:57:26,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-28 20:57:26,621 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-28 20:57:26,623 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-28 20:57:26,711 INFO [RS:0;jenkins-hbase17:33673] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C33673%2C1690577845354, suffix=, logDir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/WALs/jenkins-hbase17.apache.org,33673,1690577845354, archiveDir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/oldWALs, maxLogs=32 2023-07-28 20:57:26,730 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37805,DS-552ce744-d076-466f-89c9-3420ccc9fb68,DISK] 2023-07-28 20:57:26,730 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39459,DS-036678c1-273d-4bee-a2d1-57f5a3dbe38b,DISK] 2023-07-28 20:57:26,731 INFO [RS:0;jenkins-hbase17:33673] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/WALs/jenkins-hbase17.apache.org,33673,1690577845354/jenkins-hbase17.apache.org%2C33673%2C1690577845354.1690577846712 2023-07-28 20:57:26,732 DEBUG [RS:0;jenkins-hbase17:33673] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37805,DS-552ce744-d076-466f-89c9-3420ccc9fb68,DISK], DatanodeInfoWithStorage[127.0.0.1:39459,DS-036678c1-273d-4bee-a2d1-57f5a3dbe38b,DISK]] 2023-07-28 20:57:26,773 DEBUG [jenkins-hbase17:33529] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-28 20:57:26,774 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,33673,1690577845354, state=OPENING 2023-07-28 20:57:26,775 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-28 20:57:26,777 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:26,777 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-28 20:57:26,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,33673,1690577845354}] 2023-07-28 20:57:26,937 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,33673,1690577845354 2023-07-28 20:57:26,937 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-28 20:57:26,940 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-28 20:57:26,944 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-28 20:57:26,944 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:57:26,946 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C33673%2C1690577845354.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/WALs/jenkins-hbase17.apache.org,33673,1690577845354, archiveDir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/oldWALs, maxLogs=32 2023-07-28 20:57:26,964 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39459,DS-036678c1-273d-4bee-a2d1-57f5a3dbe38b,DISK] 2023-07-28 20:57:26,964 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37805,DS-552ce744-d076-466f-89c9-3420ccc9fb68,DISK] 2023-07-28 20:57:26,969 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/WALs/jenkins-hbase17.apache.org,33673,1690577845354/jenkins-hbase17.apache.org%2C33673%2C1690577845354.meta.1690577846947.meta 2023-07-28 20:57:26,970 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39459,DS-036678c1-273d-4bee-a2d1-57f5a3dbe38b,DISK], DatanodeInfoWithStorage[127.0.0.1:37805,DS-552ce744-d076-466f-89c9-3420ccc9fb68,DISK]] 2023-07-28 20:57:26,970 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:57:26,970 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-28 20:57:26,970 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-28 20:57:26,971 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-28 20:57:26,971 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-28 20:57:26,971 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:57:26,971 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-28 20:57:26,971 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-28 20:57:26,972 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-28 20:57:26,973 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/info 2023-07-28 20:57:26,974 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/info 2023-07-28 20:57:26,974 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-28 20:57:26,975 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:57:26,975 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-28 20:57:26,976 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/rep_barrier 2023-07-28 20:57:26,976 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/rep_barrier 2023-07-28 20:57:26,976 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-28 20:57:26,977 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:57:26,977 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-28 20:57:26,978 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/table 2023-07-28 20:57:26,978 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/table 2023-07-28 20:57:26,978 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-28 20:57:26,979 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:57:26,979 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740 2023-07-28 20:57:26,981 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740 2023-07-28 20:57:26,984 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0 M)) instead. 2023-07-28 20:57:26,985 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-28 20:57:26,986 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=703912, jitterRate=-0.10492995381355286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=16777216} 2023-07-28 20:57:26,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-28 20:57:26,987 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690577846937 2023-07-28 20:57:26,991 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-28 20:57:26,991 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-28 20:57:26,992 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,33673,1690577845354, state=OPEN 2023-07-28 20:57:26,993 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-28 20:57:26,993 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-28 20:57:26,995 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-28 20:57:26,995 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,33673,1690577845354 in 216 msec 2023-07-28 20:57:26,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-28 20:57:26,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 376 msec 2023-07-28 20:57:26,998 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 739 msec 2023-07-28 20:57:26,998 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690577846998, completionTime=-1 2023-07-28 20:57:26,998 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-28 20:57:26,998 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-28 20:57:27,001 DEBUG [hconnection-0x46a2e2ea-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-28 20:57:27,003 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-28 20:57:27,004 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-28 20:57:27,004 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690577907004 2023-07-28 20:57:27,004 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690577967004 2023-07-28 20:57:27,004 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 6 msec 2023-07-28 20:57:27,011 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,33529,1690577845197-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:27,011 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,33529,1690577845197-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:27,011 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,33529,1690577845197-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:27,011 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:33529, period=300000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:27,011 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-28 20:57:27,012 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-28 20:57:27,012 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-28 20:57:27,013 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-28 20:57:27,013 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-28 20:57:27,015 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-28 20:57:27,016 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-28 20:57:27,018 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/.tmp/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b 2023-07-28 20:57:27,019 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/.tmp/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b empty. 2023-07-28 20:57:27,019 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/.tmp/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b 2023-07-28 20:57:27,019 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-28 20:57:27,032 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-28 20:57:27,033 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7faba89ae60dfa9bfaea507ead1e664b, NAME => 'hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/.tmp 2023-07-28 20:57:27,042 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:57:27,042 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7faba89ae60dfa9bfaea507ead1e664b, disabling compactions & flushes 2023-07-28 20:57:27,042 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. 2023-07-28 20:57:27,042 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. 2023-07-28 20:57:27,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. after waiting 0 ms 2023-07-28 20:57:27,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. 2023-07-28 20:57:27,043 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. 2023-07-28 20:57:27,043 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7faba89ae60dfa9bfaea507ead1e664b: 2023-07-28 20:57:27,045 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-28 20:57:27,046 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690577847046"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690577847046"}]},"ts":"1690577847046"} 2023-07-28 20:57:27,048 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-28 20:57:27,049 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-28 20:57:27,049 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577847049"}]},"ts":"1690577847049"} 2023-07-28 20:57:27,050 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-28 20:57:27,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7faba89ae60dfa9bfaea507ead1e664b, ASSIGN}] 2023-07-28 20:57:27,057 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7faba89ae60dfa9bfaea507ead1e664b, ASSIGN 2023-07-28 20:57:27,057 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7faba89ae60dfa9bfaea507ead1e664b, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,33673,1690577845354; forceNewPlan=false, retain=false 2023-07-28 20:57:27,208 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7faba89ae60dfa9bfaea507ead1e664b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,33673,1690577845354 2023-07-28 20:57:27,209 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690577847208"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1690577847208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690577847208"}]},"ts":"1690577847208"} 2023-07-28 20:57:27,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7faba89ae60dfa9bfaea507ead1e664b, server=jenkins-hbase17.apache.org,33673,1690577845354}] 2023-07-28 20:57:27,372 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. 2023-07-28 20:57:27,372 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7faba89ae60dfa9bfaea507ead1e664b, NAME => 'hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b.', STARTKEY => '', ENDKEY => ''} 2023-07-28 20:57:27,373 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7faba89ae60dfa9bfaea507ead1e664b 2023-07-28 20:57:27,373 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-28 20:57:27,373 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 7faba89ae60dfa9bfaea507ead1e664b 2023-07-28 20:57:27,373 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 7faba89ae60dfa9bfaea507ead1e664b 2023-07-28 20:57:27,375 INFO [StoreOpener-7faba89ae60dfa9bfaea507ead1e664b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7faba89ae60dfa9bfaea507ead1e664b 2023-07-28 20:57:27,377 DEBUG [StoreOpener-7faba89ae60dfa9bfaea507ead1e664b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b/info 2023-07-28 20:57:27,377 DEBUG [StoreOpener-7faba89ae60dfa9bfaea507ead1e664b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b/info 2023-07-28 20:57:27,377 INFO [StoreOpener-7faba89ae60dfa9bfaea507ead1e664b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7faba89ae60dfa9bfaea507ead1e664b columnFamilyName info 2023-07-28 20:57:27,378 INFO [StoreOpener-7faba89ae60dfa9bfaea507ead1e664b-1] regionserver.HStore(310): Store=7faba89ae60dfa9bfaea507ead1e664b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-28 20:57:27,379 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b 2023-07-28 20:57:27,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b 2023-07-28 20:57:27,383 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 7faba89ae60dfa9bfaea507ead1e664b 2023-07-28 20:57:27,389 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-28 20:57:27,390 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 7faba89ae60dfa9bfaea507ead1e664b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=16384, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=843517, jitterRate=0.07258851826190948}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-28 20:57:27,390 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 7faba89ae60dfa9bfaea507ead1e664b: 2023-07-28 20:57:27,392 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b., pid=6, masterSystemTime=1690577847364 2023-07-28 20:57:27,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. 2023-07-28 20:57:27,394 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. 2023-07-28 20:57:27,395 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7faba89ae60dfa9bfaea507ead1e664b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,33673,1690577845354 2023-07-28 20:57:27,395 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690577847395"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1690577847395"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690577847395"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690577847395"}]},"ts":"1690577847395"} 2023-07-28 20:57:27,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-28 20:57:27,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7faba89ae60dfa9bfaea507ead1e664b, server=jenkins-hbase17.apache.org,33673,1690577845354 in 185 msec 2023-07-28 20:57:27,402 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-28 20:57:27,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7faba89ae60dfa9bfaea507ead1e664b, ASSIGN in 343 msec 2023-07-28 20:57:27,404 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-28 20:57:27,404 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690577847404"}]},"ts":"1690577847404"} 2023-07-28 20:57:27,406 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-28 20:57:27,410 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-28 20:57:27,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 398 msec 2023-07-28 20:57:27,414 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-28 20:57:27,415 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-28 20:57:27,415 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:27,420 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-28 20:57:27,432 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-28 20:57:27,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 15 msec 2023-07-28 20:57:27,443 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-28 20:57:27,453 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-28 20:57:27,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-07-28 20:57:27,467 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-28 20:57:27,469 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-28 20:57:27,470 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.954sec 2023-07-28 20:57:27,470 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-28 20:57:27,470 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-28 20:57:27,470 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-28 20:57:27,470 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,33529,1690577845197-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-28 20:57:27,470 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,33529,1690577845197-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-28 20:57:27,485 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-28 20:57:27,508 DEBUG [Listener at localhost.localdomain/33897] zookeeper.ReadOnlyZKClient(139): Connect 0x69c1ae0c to 127.0.0.1:51130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-28 20:57:27,517 DEBUG [Listener at localhost.localdomain/33897] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fb06b8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-28 20:57:27,520 DEBUG [hconnection-0xcb6c61c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-28 20:57:27,522 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-28 20:57:27,524 INFO [Listener at localhost.localdomain/33897] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,33529,1690577845197 2023-07-28 20:57:27,524 INFO [Listener at localhost.localdomain/33897] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-28 20:57:27,527 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-28 20:57:27,527 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:27,528 INFO [Listener at localhost.localdomain/33897] master.MasterRpcServices(492): Client=null/null set balanceSwitch=false 2023-07-28 20:57:27,528 INFO [Listener at localhost.localdomain/33897] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-28 20:57:27,537 INFO [Listener at localhost.localdomain/33897] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=test.com%2C8080%2C1, suffix=, logDir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/WALs/test.com,8080,1, archiveDir=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/oldWALs, maxLogs=32 2023-07-28 20:57:27,553 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39459,DS-036678c1-273d-4bee-a2d1-57f5a3dbe38b,DISK] 2023-07-28 20:57:27,554 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37805,DS-552ce744-d076-466f-89c9-3420ccc9fb68,DISK] 2023-07-28 20:57:27,555 INFO [Listener at localhost.localdomain/33897] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/WALs/test.com,8080,1/test.com%2C8080%2C1.1690577847538 2023-07-28 20:57:27,556 DEBUG [Listener at localhost.localdomain/33897] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39459,DS-036678c1-273d-4bee-a2d1-57f5a3dbe38b,DISK], DatanodeInfoWithStorage[127.0.0.1:37805,DS-552ce744-d076-466f-89c9-3420ccc9fb68,DISK]] 2023-07-28 20:57:27,570 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39459,DS-036678c1-273d-4bee-a2d1-57f5a3dbe38b,DISK] 2023-07-28 20:57:27,571 DEBUG [AsyncFSWAL-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = /127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37805,DS-552ce744-d076-466f-89c9-3420ccc9fb68,DISK] 2023-07-28 20:57:27,577 INFO [Listener at localhost.localdomain/33897] wal.AbstractFSWAL(802): Rolled WAL /user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/WALs/test.com,8080,1/test.com%2C8080%2C1.1690577847538 with entries=0, filesize=83 B; new WAL /user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/WALs/test.com,8080,1/test.com%2C8080%2C1.1690577847556 2023-07-28 20:57:27,578 DEBUG [Listener at localhost.localdomain/33897] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39459,DS-036678c1-273d-4bee-a2d1-57f5a3dbe38b,DISK], DatanodeInfoWithStorage[127.0.0.1:37805,DS-552ce744-d076-466f-89c9-3420ccc9fb68,DISK]] 2023-07-28 20:57:27,578 DEBUG [Listener at localhost.localdomain/33897] wal.AbstractFSWAL(716): hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/WALs/test.com,8080,1/test.com%2C8080%2C1.1690577847538 is not closed yet, will try archiving it next time 2023-07-28 20:57:27,590 INFO [WAL-Archive-0] wal.AbstractFSWAL(783): Archiving hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/WALs/test.com,8080,1/test.com%2C8080%2C1.1690577847538 to hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/oldWALs/test.com%2C8080%2C1.1690577847538 2023-07-28 20:57:27,593 DEBUG [Listener at localhost.localdomain/33897] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/oldWALs 2023-07-28 20:57:27,593 INFO [Listener at localhost.localdomain/33897] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL test.com%2C8080%2C1:(num 1690577847556) 2023-07-28 20:57:27,593 INFO [Listener at localhost.localdomain/33897] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-28 20:57:27,593 DEBUG [Listener at localhost.localdomain/33897] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69c1ae0c to 127.0.0.1:51130 2023-07-28 20:57:27,593 DEBUG [Listener at localhost.localdomain/33897] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:57:27,596 DEBUG [Listener at localhost.localdomain/33897] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-28 20:57:27,596 DEBUG [Listener at localhost.localdomain/33897] util.JVMClusterUtil(257): Found active master hash=1191291886, stopped=false 2023-07-28 20:57:27,596 INFO [Listener at localhost.localdomain/33897] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,33529,1690577845197 2023-07-28 20:57:27,598 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-28 20:57:27,598 INFO [Listener at localhost.localdomain/33897] procedure2.ProcedureExecutor(629): Stopping 2023-07-28 20:57:27,598 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:27,598 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): regionserver:33673-0x101adb836670001, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-28 20:57:27,599 DEBUG [Listener at localhost.localdomain/33897] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b7612df to 127.0.0.1:51130 2023-07-28 20:57:27,599 DEBUG [Listener at localhost.localdomain/33897] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:57:27,599 INFO [Listener at localhost.localdomain/33897] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,33673,1690577845354' ***** 2023-07-28 20:57:27,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33673-0x101adb836670001, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:57:27,599 INFO [Listener at localhost.localdomain/33897] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-28 20:57:27,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-28 20:57:27,600 INFO [RS:0;jenkins-hbase17:33673] regionserver.HeapMemoryManager(220): Stopping 2023-07-28 20:57:27,600 INFO [RS:0;jenkins-hbase17:33673] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-28 20:57:27,600 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-28 20:57:27,600 INFO [RS:0;jenkins-hbase17:33673] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-28 20:57:27,600 INFO [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(3305): Received CLOSE for 7faba89ae60dfa9bfaea507ead1e664b 2023-07-28 20:57:27,601 INFO [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,33673,1690577845354 2023-07-28 20:57:27,601 DEBUG [RS:0;jenkins-hbase17:33673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cdb76cf to 127.0.0.1:51130 2023-07-28 20:57:27,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 7faba89ae60dfa9bfaea507ead1e664b, disabling compactions & flushes 2023-07-28 20:57:27,601 DEBUG [RS:0;jenkins-hbase17:33673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:57:27,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. 2023-07-28 20:57:27,602 INFO [RS:0;jenkins-hbase17:33673] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-28 20:57:27,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. 2023-07-28 20:57:27,602 INFO [RS:0;jenkins-hbase17:33673] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-28 20:57:27,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. after waiting 0 ms 2023-07-28 20:57:27,602 INFO [RS:0;jenkins-hbase17:33673] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-28 20:57:27,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. 2023-07-28 20:57:27,602 INFO [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-28 20:57:27,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 7faba89ae60dfa9bfaea507ead1e664b 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-28 20:57:27,602 INFO [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-28 20:57:27,602 DEBUG [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 7faba89ae60dfa9bfaea507ead1e664b=hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b.} 2023-07-28 20:57:27,603 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-28 20:57:27,603 DEBUG [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1504): Waiting on 1588230740, 7faba89ae60dfa9bfaea507ead1e664b 2023-07-28 20:57:27,603 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-28 20:57:27,603 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-28 20:57:27,603 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-28 20:57:27,603 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-28 20:57:27,603 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=1.26 KB heapSize=2.89 KB 2023-07-28 20:57:27,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b/.tmp/info/712b163ac9044778bca4f37baf4db0b0 2023-07-28 20:57:27,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b/.tmp/info/712b163ac9044778bca4f37baf4db0b0 as hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b/info/712b163ac9044778bca4f37baf4db0b0 2023-07-28 20:57:27,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b/info/712b163ac9044778bca4f37baf4db0b0, entries=2, sequenceid=6, filesize=4.8 K 2023-07-28 20:57:27,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7faba89ae60dfa9bfaea507ead1e664b in 65ms, sequenceid=6, compaction requested=false 2023-07-28 20:57:27,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/namespace/7faba89ae60dfa9bfaea507ead1e664b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-28 20:57:27,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. 2023-07-28 20:57:27,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 7faba89ae60dfa9bfaea507ead1e664b: 2023-07-28 20:57:27,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690577847012.7faba89ae60dfa9bfaea507ead1e664b. 2023-07-28 20:57:27,803 DEBUG [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-28 20:57:28,004 DEBUG [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-28 20:57:28,052 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.17 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/.tmp/info/8d441575ab95428e9606bbcba1d6cd62 2023-07-28 20:57:28,072 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=94 B at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/.tmp/table/fdc5f3bb84a2433fb58f16f012dba094 2023-07-28 20:57:28,079 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/.tmp/info/8d441575ab95428e9606bbcba1d6cd62 as hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/info/8d441575ab95428e9606bbcba1d6cd62 2023-07-28 20:57:28,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/info/8d441575ab95428e9606bbcba1d6cd62, entries=10, sequenceid=9, filesize=5.9 K 2023-07-28 20:57:28,087 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/.tmp/table/fdc5f3bb84a2433fb58f16f012dba094 as hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/table/fdc5f3bb84a2433fb58f16f012dba094 2023-07-28 20:57:28,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/table/fdc5f3bb84a2433fb58f16f012dba094, entries=2, sequenceid=9, filesize=4.7 K 2023-07-28 20:57:28,095 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.26 KB/1292, heapSize ~2.61 KB/2672, currentSize=0 B/0 for 1588230740 in 492ms, sequenceid=9, compaction requested=false 2023-07-28 20:57:28,095 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-28 20:57:28,112 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/data/hbase/meta/1588230740/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-07-28 20:57:28,114 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-28 20:57:28,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-28 20:57:28,115 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-28 20:57:28,115 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-28 20:57:28,204 INFO [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,33673,1690577845354; all regions closed. 2023-07-28 20:57:28,215 DEBUG [RS:0;jenkins-hbase17:33673] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/oldWALs 2023-07-28 20:57:28,215 INFO [RS:0;jenkins-hbase17:33673] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C33673%2C1690577845354.meta:.meta(num 1690577846947) 2023-07-28 20:57:28,225 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/WALs/jenkins-hbase17.apache.org,33673,1690577845354/jenkins-hbase17.apache.org%2C33673%2C1690577845354.1690577846712 not finished, retry = 0 2023-07-28 20:57:28,329 DEBUG [RS:0;jenkins-hbase17:33673] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/oldWALs 2023-07-28 20:57:28,329 INFO [RS:0;jenkins-hbase17:33673] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C33673%2C1690577845354:(num 1690577846712) 2023-07-28 20:57:28,329 DEBUG [RS:0;jenkins-hbase17:33673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:57:28,329 INFO [RS:0;jenkins-hbase17:33673] regionserver.LeaseManager(133): Closed leases 2023-07-28 20:57:28,330 INFO [RS:0;jenkins-hbase17:33673] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-28 20:57:28,330 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-28 20:57:28,331 INFO [RS:0;jenkins-hbase17:33673] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:33673 2023-07-28 20:57:28,334 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): regionserver:33673-0x101adb836670001, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,33673,1690577845354 2023-07-28 20:57:28,334 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): regionserver:33673-0x101adb836670001, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-28 20:57:28,334 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-28 20:57:28,335 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,33673,1690577845354] 2023-07-28 20:57:28,335 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,33673,1690577845354; numProcessing=1 2023-07-28 20:57:28,435 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): regionserver:33673-0x101adb836670001, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:57:28,435 INFO [RS:0;jenkins-hbase17:33673] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,33673,1690577845354; zookeeper connection closed. 2023-07-28 20:57:28,435 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): regionserver:33673-0x101adb836670001, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:57:28,436 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3ac2985e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3ac2985e 2023-07-28 20:57:28,436 INFO [Listener at localhost.localdomain/33897] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-28 20:57:28,436 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,33673,1690577845354 already deleted, retry=false 2023-07-28 20:57:28,437 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,33673,1690577845354 expired; onlineServers=0 2023-07-28 20:57:28,437 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,33529,1690577845197' ***** 2023-07-28 20:57:28,437 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-28 20:57:28,437 DEBUG [M:0;jenkins-hbase17:33529] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@433e37d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-28 20:57:28,437 INFO [M:0;jenkins-hbase17:33529] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,33529,1690577845197 2023-07-28 20:57:28,437 INFO [M:0;jenkins-hbase17:33529] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,33529,1690577845197; all regions closed. 2023-07-28 20:57:28,437 DEBUG [M:0;jenkins-hbase17:33529] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-28 20:57:28,437 DEBUG [M:0;jenkins-hbase17:33529] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-28 20:57:28,438 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-28 20:57:28,438 DEBUG [M:0;jenkins-hbase17:33529] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-28 20:57:28,438 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690577846290] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1690577846290,5,FailOnTimeoutGroup] 2023-07-28 20:57:28,438 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690577846291] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1690577846291,5,FailOnTimeoutGroup] 2023-07-28 20:57:28,438 INFO [M:0;jenkins-hbase17:33529] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-28 20:57:28,439 INFO [M:0;jenkins-hbase17:33529] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-28 20:57:28,439 INFO [M:0;jenkins-hbase17:33529] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-28 20:57:28,439 DEBUG [M:0;jenkins-hbase17:33529] master.HMaster(1512): Stopping service threads 2023-07-28 20:57:28,439 INFO [M:0;jenkins-hbase17:33529] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-28 20:57:28,439 ERROR [M:0;jenkins-hbase17:33529] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-7,5,PEWorkerGroup] 2023-07-28 20:57:28,439 INFO [M:0;jenkins-hbase17:33529] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-28 20:57:28,439 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-28 20:57:28,439 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-28 20:57:28,440 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-28 20:57:28,440 DEBUG [M:0;jenkins-hbase17:33529] zookeeper.ZKUtil(398): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-28 20:57:28,440 WARN [M:0;jenkins-hbase17:33529] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-28 20:57:28,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-28 20:57:28,440 INFO [M:0;jenkins-hbase17:33529] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-28 20:57:28,440 INFO [M:0;jenkins-hbase17:33529] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-28 20:57:28,441 DEBUG [M:0;jenkins-hbase17:33529] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-28 20:57:28,441 INFO [M:0;jenkins-hbase17:33529] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:57:28,441 DEBUG [M:0;jenkins-hbase17:33529] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:57:28,441 DEBUG [M:0;jenkins-hbase17:33529] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-28 20:57:28,441 DEBUG [M:0;jenkins-hbase17:33529] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:57:28,441 INFO [M:0;jenkins-hbase17:33529] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=24.09 KB heapSize=29.59 KB 2023-07-28 20:57:28,460 INFO [M:0;jenkins-hbase17:33529] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24.09 KB at sequenceid=66 (bloomFilter=true), to=hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/85ebcf0b860c447abfc71070208b540f 2023-07-28 20:57:28,467 DEBUG [M:0;jenkins-hbase17:33529] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/85ebcf0b860c447abfc71070208b540f as hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/85ebcf0b860c447abfc71070208b540f 2023-07-28 20:57:28,474 INFO [M:0;jenkins-hbase17:33529] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44719/user/jenkins/test-data/f39c6873-afa4-51e6-07fc-ec195415b212/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/85ebcf0b860c447abfc71070208b540f, entries=8, sequenceid=66, filesize=6.3 K 2023-07-28 20:57:28,475 INFO [M:0;jenkins-hbase17:33529] regionserver.HRegion(2948): Finished flush of dataSize ~24.09 KB/24669, heapSize ~29.57 KB/30280, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 34ms, sequenceid=66, compaction requested=false 2023-07-28 20:57:28,478 INFO [M:0;jenkins-hbase17:33529] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-28 20:57:28,478 DEBUG [M:0;jenkins-hbase17:33529] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-28 20:57:28,494 INFO [M:0;jenkins-hbase17:33529] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-28 20:57:28,494 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-28 20:57:28,495 INFO [M:0;jenkins-hbase17:33529] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:33529 2023-07-28 20:57:28,498 DEBUG [M:0;jenkins-hbase17:33529] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,33529,1690577845197 already deleted, retry=false 2023-07-28 20:57:28,536 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-28 20:57:28,599 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:57:28,599 INFO [M:0;jenkins-hbase17:33529] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,33529,1690577845197; zookeeper connection closed. 2023-07-28 20:57:28,599 DEBUG [Listener at localhost.localdomain/33897-EventThread] zookeeper.ZKWatcher(600): master:33529-0x101adb836670000, quorum=127.0.0.1:51130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-28 20:57:28,601 WARN [Listener at localhost.localdomain/33897] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-28 20:57:28,611 INFO [Listener at localhost.localdomain/33897] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-28 20:57:28,656 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-28 20:57:28,734 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-28 20:57:28,740 WARN [BP-1082424357-136.243.18.41-1690577844262 heartbeating to localhost.localdomain/127.0.0.1:44719] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-28 20:57:28,740 WARN [BP-1082424357-136.243.18.41-1690577844262 heartbeating to localhost.localdomain/127.0.0.1:44719] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1082424357-136.243.18.41-1690577844262 (Datanode Uuid 627ffccb-5761-4eaa-af0f-3c680fefce6a) service to localhost.localdomain/127.0.0.1:44719 2023-07-28 20:57:28,742 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/cluster_f5ab5092-ac61-904a-3463-5e5dcb2292e6/dfs/data/data3/current/BP-1082424357-136.243.18.41-1690577844262] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:57:28,753 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/cluster_f5ab5092-ac61-904a-3463-5e5dcb2292e6/dfs/data/data4/current/BP-1082424357-136.243.18.41-1690577844262] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:57:28,760 WARN [Listener at localhost.localdomain/33897] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-28 20:57:28,803 INFO [Listener at localhost.localdomain/33897] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-28 20:57:28,916 WARN [BP-1082424357-136.243.18.41-1690577844262 heartbeating to localhost.localdomain/127.0.0.1:44719] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-28 20:57:28,916 WARN [BP-1082424357-136.243.18.41-1690577844262 heartbeating to localhost.localdomain/127.0.0.1:44719] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1082424357-136.243.18.41-1690577844262 (Datanode Uuid 289a83e7-4e0e-44d9-9b11-a9cfecfeacce) service to localhost.localdomain/127.0.0.1:44719 2023-07-28 20:57:28,916 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/cluster_f5ab5092-ac61-904a-3463-5e5dcb2292e6/dfs/data/data1/current/BP-1082424357-136.243.18.41-1690577844262] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:57:28,917 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8fa59fa2-66b1-a920-0247-455346830094/cluster_f5ab5092-ac61-904a-3463-5e5dcb2292e6/dfs/data/data2/current/BP-1082424357-136.243.18.41-1690577844262] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-28 20:57:28,934 INFO [Listener at localhost.localdomain/33897] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-28 20:57:29,045 INFO [Listener at localhost.localdomain/33897] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-28 20:57:29,066 INFO [Listener at localhost.localdomain/33897] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-28 20:57:29,082 INFO [Listener at localhost.localdomain/33897] hbase.ResourceChecker(175): after: regionserver.wal.TestAsyncLogRolling#testLogRollOnNothingWritten Thread=101 (was 76) - Thread LEAK? -, OpenFileDescriptor=484 (was 462) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=915 (was 873) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 190), AvailableMemoryMB=864 (was 1199)