2024-01-14 05:55:24,414 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-01-14 05:55:24,655 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01 2024-01-14 05:55:24,673 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-01-14 05:55:24,674 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/cluster_86bc26f8-88aa-e80f-6465-53e5bf824867, deleteOnExit=true 2024-01-14 05:55:24,674 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-01-14 05:55:24,675 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/test.cache.data in system properties and HBase conf 2024-01-14 05:55:24,675 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/hadoop.tmp.dir in system properties and HBase conf 2024-01-14 05:55:24,676 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/hadoop.log.dir in system properties and HBase conf 2024-01-14 05:55:24,677 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/mapreduce.cluster.local.dir in system properties and HBase conf 2024-01-14 05:55:24,677 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-01-14 05:55:24,677 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-01-14 05:55:24,802 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-01-14 05:55:25,265 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-14 05:55:25,269 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-01-14 05:55:25,269 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-01-14 05:55:25,270 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-01-14 05:55:25,270 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-01-14 05:55:25,270 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-01-14 05:55:25,271 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-01-14 05:55:25,271 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-01-14 05:55:25,271 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/dfs.journalnode.edits.dir in system properties and HBase conf 2024-01-14 05:55:25,271 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-01-14 05:55:25,272 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/nfs.dump.dir in system properties and HBase conf 2024-01-14 05:55:25,272 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/java.io.tmpdir in system properties and HBase conf 2024-01-14 05:55:25,272 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/dfs.journalnode.edits.dir in system properties and HBase conf 2024-01-14 05:55:25,272 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-01-14 05:55:25,273 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-01-14 05:55:25,849 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-01-14 05:55:25,853 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-01-14 05:55:26,151 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-01-14 05:55:26,300 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-01-14 05:55:26,315 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-14 05:55:26,353 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-01-14 05:55:26,388 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/java.io.tmpdir/Jetty_localhost_37205_hdfs____.2hfvyb/webapp 2024-01-14 05:55:26,534 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37205 2024-01-14 05:55:26,544 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-01-14 05:55:26,544 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-01-14 05:55:27,048 WARN [Listener at localhost/37135] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-14 05:55:27,135 WARN [Listener at localhost/37135] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-01-14 05:55:27,158 WARN [Listener at localhost/37135] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-14 05:55:27,165 INFO [Listener at localhost/37135] log.Slf4jLog(67): jetty-6.1.26 2024-01-14 05:55:27,169 INFO [Listener at localhost/37135] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/java.io.tmpdir/Jetty_localhost_36997_datanode____.frb4n9/webapp 2024-01-14 05:55:27,283 INFO [Listener at localhost/37135] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36997 2024-01-14 05:55:27,578 WARN [Listener at localhost/40373] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-14 05:55:27,588 WARN [Listener at localhost/40373] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-01-14 05:55:27,592 WARN [Listener at localhost/40373] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-14 05:55:27,594 INFO [Listener at localhost/40373] log.Slf4jLog(67): jetty-6.1.26 2024-01-14 05:55:27,599 INFO [Listener at localhost/40373] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/java.io.tmpdir/Jetty_localhost_42569_datanode____r2r71d/webapp 2024-01-14 05:55:27,695 INFO [Listener at localhost/40373] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42569 2024-01-14 05:55:27,703 WARN [Listener at localhost/35313] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-14 05:55:28,034 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xae2ab97083a27d29: Processing first storage report for DS-37b4ff79-8beb-42f3-a820-a4d318dba4fc from datanode 49504216-a62f-4fec-b4cd-addce9afabb1 2024-01-14 05:55:28,036 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae2ab97083a27d29: from storage DS-37b4ff79-8beb-42f3-a820-a4d318dba4fc node DatanodeRegistration(127.0.0.1:33119, datanodeUuid=49504216-a62f-4fec-b4cd-addce9afabb1, infoPort=41555, infoSecurePort=0, ipcPort=40373, storageInfo=lv=-57;cid=testClusterID;nsid=1700951080;c=1705211725929), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-01-14 05:55:28,037 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x40ab7539b0aba819: Processing first storage report for DS-839fde26-5918-4f1f-ba86-921b3ac6db48 from datanode afdad90d-b1c5-4a9c-8bfd-dc59ece2a80e 2024-01-14 05:55:28,037 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x40ab7539b0aba819: from storage DS-839fde26-5918-4f1f-ba86-921b3ac6db48 node DatanodeRegistration(127.0.0.1:33985, datanodeUuid=afdad90d-b1c5-4a9c-8bfd-dc59ece2a80e, infoPort=38825, infoSecurePort=0, ipcPort=35313, storageInfo=lv=-57;cid=testClusterID;nsid=1700951080;c=1705211725929), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2024-01-14 05:55:28,037 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xae2ab97083a27d29: Processing first storage report for DS-9f37a90c-b82c-4eac-9646-64c7d70a24ac from datanode 49504216-a62f-4fec-b4cd-addce9afabb1 2024-01-14 05:55:28,037 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae2ab97083a27d29: from storage DS-9f37a90c-b82c-4eac-9646-64c7d70a24ac node DatanodeRegistration(127.0.0.1:33119, datanodeUuid=49504216-a62f-4fec-b4cd-addce9afabb1, infoPort=41555, infoSecurePort=0, ipcPort=40373, storageInfo=lv=-57;cid=testClusterID;nsid=1700951080;c=1705211725929), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-14 05:55:28,037 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x40ab7539b0aba819: Processing first storage report for DS-6ced2184-c650-42f5-9a95-8098256521c0 from datanode afdad90d-b1c5-4a9c-8bfd-dc59ece2a80e 2024-01-14 05:55:28,038 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x40ab7539b0aba819: from storage DS-6ced2184-c650-42f5-9a95-8098256521c0 node DatanodeRegistration(127.0.0.1:33985, datanodeUuid=afdad90d-b1c5-4a9c-8bfd-dc59ece2a80e, infoPort=38825, infoSecurePort=0, ipcPort=35313, storageInfo=lv=-57;cid=testClusterID;nsid=1700951080;c=1705211725929), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-14 05:55:28,092 DEBUG [Listener at localhost/35313] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01 2024-01-14 05:55:28,213 INFO [Listener at localhost/35313] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/cluster_86bc26f8-88aa-e80f-6465-53e5bf824867/zookeeper_0, clientPort=52071, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/cluster_86bc26f8-88aa-e80f-6465-53e5bf824867/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/cluster_86bc26f8-88aa-e80f-6465-53e5bf824867/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-01-14 05:55:28,228 INFO [Listener at localhost/35313] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52071 2024-01-14 05:55:28,236 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 05:55:28,238 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 05:55:28,920 INFO [Listener at localhost/35313] util.FSUtils(471): Created version file at hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd with version=8 2024-01-14 05:55:28,920 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/hbase-staging 2024-01-14 05:55:29,241 INFO [Listener at localhost/35313] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-01-14 05:55:29,687 INFO [Listener at localhost/35313] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-01-14 05:55:29,718 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-14 05:55:29,718 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-14 05:55:29,719 INFO [Listener at localhost/35313] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-14 05:55:29,719 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-14 05:55:29,719 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-14 05:55:29,859 INFO [Listener at localhost/35313] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-01-14 05:55:29,928 DEBUG [Listener at localhost/35313] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-01-14 05:55:30,022 INFO [Listener at localhost/35313] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44089 2024-01-14 05:55:30,031 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 05:55:30,033 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 05:55:30,057 INFO [Listener at localhost/35313] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44089 connecting to ZooKeeper ensemble=127.0.0.1:52071 2024-01-14 05:55:30,105 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:440890x0, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-14 05:55:30,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44089-0x1012499f55f0000 connected 2024-01-14 05:55:30,137 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(165): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-14 05:55:30,138 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(165): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-14 05:55:30,141 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(165): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-14 05:55:30,149 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44089 2024-01-14 05:55:30,149 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44089 2024-01-14 05:55:30,150 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44089 2024-01-14 05:55:30,150 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44089 2024-01-14 05:55:30,151 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44089 2024-01-14 05:55:30,156 INFO [Listener at localhost/35313] master.HMaster(445): hbase.rootdir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd, hbase.cluster.distributed=false 2024-01-14 05:55:30,222 INFO [Listener at localhost/35313] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-01-14 05:55:30,223 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-14 05:55:30,223 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-14 05:55:30,223 INFO [Listener at localhost/35313] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-14 05:55:30,223 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-14 05:55:30,223 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-14 05:55:30,228 INFO [Listener at localhost/35313] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-01-14 05:55:30,231 INFO [Listener at localhost/35313] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38377 2024-01-14 05:55:30,233 INFO [Listener at localhost/35313] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-14 05:55:30,239 DEBUG [Listener at localhost/35313] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-01-14 05:55:30,240 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 05:55:30,242 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 05:55:30,244 INFO [Listener at localhost/35313] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38377 connecting to ZooKeeper ensemble=127.0.0.1:52071 2024-01-14 05:55:30,248 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:383770x0, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-14 05:55:30,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38377-0x1012499f55f0001 connected 2024-01-14 05:55:30,249 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(165): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-14 05:55:30,250 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(165): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-14 05:55:30,251 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(165): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-14 05:55:30,253 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38377 2024-01-14 05:55:30,253 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38377 2024-01-14 05:55:30,253 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38377 2024-01-14 05:55:30,254 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38377 2024-01-14 05:55:30,254 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38377 2024-01-14 05:55:30,267 INFO [Listener at localhost/35313] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-01-14 05:55:30,267 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-14 05:55:30,267 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-14 05:55:30,268 INFO [Listener at localhost/35313] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-14 05:55:30,268 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-14 05:55:30,268 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-14 05:55:30,268 INFO [Listener at localhost/35313] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-01-14 05:55:30,273 INFO [Listener at localhost/35313] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35407 2024-01-14 05:55:30,273 INFO [Listener at localhost/35313] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-14 05:55:30,274 DEBUG [Listener at localhost/35313] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-01-14 05:55:30,275 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 05:55:30,276 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 05:55:30,279 INFO [Listener at localhost/35313] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35407 connecting to ZooKeeper ensemble=127.0.0.1:52071 2024-01-14 05:55:30,282 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:354070x0, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-14 05:55:30,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35407-0x1012499f55f0002 connected 2024-01-14 05:55:30,284 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(165): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-14 05:55:30,284 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(165): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-14 05:55:30,285 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(165): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-14 05:55:30,286 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35407 2024-01-14 05:55:30,286 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35407 2024-01-14 05:55:30,286 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35407 2024-01-14 05:55:30,287 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35407 2024-01-14 05:55:30,287 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35407 2024-01-14 05:55:30,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44089,1705211729063 2024-01-14 05:55:30,299 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-01-14 05:55:30,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44089,1705211729063 2024-01-14 05:55:30,320 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-14 05:55:30,320 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-14 05:55:30,320 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-14 05:55:30,321 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 05:55:30,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-01-14 05:55:30,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44089,1705211729063 from backup master directory 2024-01-14 05:55:30,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-01-14 05:55:30,327 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44089,1705211729063 2024-01-14 05:55:30,327 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-01-14 05:55:30,328 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-14 05:55:30,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44089,1705211729063 2024-01-14 05:55:30,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-01-14 05:55:30,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-01-14 05:55:30,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/hbase.id with ID: f8c04a78-2738-42fe-8a13-91b928962df0 2024-01-14 05:55:30,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 05:55:30,475 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 05:55:30,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2604a8df to 127.0.0.1:52071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-14 05:55:30,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b02af8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-14 05:55:30,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-14 05:55:30,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-01-14 05:55:30,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-01-14 05:55:30,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-01-14 05:55:30,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-01-14 05:55:30,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-01-14 05:55:30,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-14 05:55:30,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/data/master/store-tmp 2024-01-14 05:55:30,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:30,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-01-14 05:55:30,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 05:55:30,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 05:55:30,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-01-14 05:55:30,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 05:55:30,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 05:55:30,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-14 05:55:30,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/WALs/jenkins-hbase4.apache.org,44089,1705211729063 2024-01-14 05:55:30,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44089%2C1705211729063, suffix=, logDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/WALs/jenkins-hbase4.apache.org,44089,1705211729063, archiveDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/oldWALs, maxLogs=10 2024-01-14 05:55:30,758 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33985,DS-839fde26-5918-4f1f-ba86-921b3ac6db48,DISK] 2024-01-14 05:55:30,758 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33119,DS-37b4ff79-8beb-42f3-a820-a4d318dba4fc,DISK] 2024-01-14 05:55:30,769 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-01-14 05:55:30,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/WALs/jenkins-hbase4.apache.org,44089,1705211729063/jenkins-hbase4.apache.org%2C44089%2C1705211729063.1705211730711 2024-01-14 05:55:30,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33985,DS-839fde26-5918-4f1f-ba86-921b3ac6db48,DISK], DatanodeInfoWithStorage[127.0.0.1:33119,DS-37b4ff79-8beb-42f3-a820-a4d318dba4fc,DISK]] 2024-01-14 05:55:30,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-01-14 05:55:30,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:30,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-01-14 05:55:30,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-01-14 05:55:30,912 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-01-14 05:55:30,920 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-01-14 05:55:30,944 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-01-14 05:55:30,958 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:30,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-01-14 05:55:30,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-01-14 05:55:30,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-01-14 05:55:30,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 05:55:30,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63811373, jitterRate=-0.0491364449262619}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 05:55:30,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-14 05:55:30,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-01-14 05:55:31,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-01-14 05:55:31,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-01-14 05:55:31,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-01-14 05:55:31,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-01-14 05:55:31,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 56 msec 2024-01-14 05:55:31,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-01-14 05:55:31,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-01-14 05:55:31,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-01-14 05:55:31,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-01-14 05:55:31,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-01-14 05:55:31,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-01-14 05:55:31,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-01-14 05:55:31,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-01-14 05:55:31,341 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 05:55:31,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-01-14 05:55:31,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-01-14 05:55:31,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-01-14 05:55:31,393 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-14 05:55:31,393 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-14 05:55:31,393 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-14 05:55:31,394 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 05:55:31,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,44089,1705211729063, sessionid=0x1012499f55f0000, setting cluster-up flag (Was=false) 2024-01-14 05:55:31,423 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 05:55:31,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-01-14 05:55:31,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44089,1705211729063 2024-01-14 05:55:31,452 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 05:55:31,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-01-14 05:55:31,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44089,1705211729063 2024-01-14 05:55:31,466 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.hbase-snapshot/.tmp 2024-01-14 05:55:31,615 INFO [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(954): ClusterId : f8c04a78-2738-42fe-8a13-91b928962df0 2024-01-14 05:55:31,622 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(954): ClusterId : f8c04a78-2738-42fe-8a13-91b928962df0 2024-01-14 05:55:31,627 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-01-14 05:55:31,627 DEBUG [RS:0;jenkins-hbase4:38377] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-01-14 05:55:31,649 DEBUG [RS:0;jenkins-hbase4:38377] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-01-14 05:55:31,649 DEBUG [RS:0;jenkins-hbase4:38377] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-01-14 05:55:31,653 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-01-14 05:55:31,653 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-01-14 05:55:31,654 DEBUG [RS:0;jenkins-hbase4:38377] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-01-14 05:55:31,657 DEBUG [RS:0;jenkins-hbase4:38377] zookeeper.ReadOnlyZKClient(139): Connect 0x35f20ff3 to 127.0.0.1:52071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-14 05:55:31,681 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-01-14 05:55:31,684 DEBUG [RS:1;jenkins-hbase4:35407] zookeeper.ReadOnlyZKClient(139): Connect 0x71266041 to 127.0.0.1:52071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-14 05:55:31,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-01-14 05:55:31,785 DEBUG [RS:1;jenkins-hbase4:35407] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fe18015, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-14 05:55:31,787 DEBUG [RS:1;jenkins-hbase4:35407] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bde0b31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-14 05:55:31,790 DEBUG [RS:0;jenkins-hbase4:38377] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b35e73d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-14 05:55:31,790 DEBUG [RS:0;jenkins-hbase4:38377] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f0a6483, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-14 05:55:31,832 DEBUG [RS:0;jenkins-hbase4:38377] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38377 2024-01-14 05:55:31,834 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35407 2024-01-14 05:55:31,839 INFO [RS:0;jenkins-hbase4:38377] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-01-14 05:55:31,840 INFO [RS:0;jenkins-hbase4:38377] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-01-14 05:55:31,840 DEBUG [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1025): About to register with Master. 2024-01-14 05:55:31,844 INFO [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,44089,1705211729063 with isa=jenkins-hbase4.apache.org/172.31.14.131:38377, startcode=1705211730222 2024-01-14 05:55:31,845 INFO [RS:1;jenkins-hbase4:35407] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-01-14 05:55:31,853 INFO [RS:1;jenkins-hbase4:35407] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-01-14 05:55:31,853 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1025): About to register with Master. 2024-01-14 05:55:31,854 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,44089,1705211729063 with isa=jenkins-hbase4.apache.org/172.31.14.131:35407, startcode=1705211730266 2024-01-14 05:55:31,894 DEBUG [RS:1;jenkins-hbase4:35407] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-01-14 05:55:31,895 DEBUG [RS:0;jenkins-hbase4:38377] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-01-14 05:55:31,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-01-14 05:55:32,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-14 05:55:32,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-14 05:55:32,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-14 05:55:32,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-14 05:55:32,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-01-14 05:55:32,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-14 05:55:32,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1705211762099 2024-01-14 05:55:32,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-01-14 05:55:32,218 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-01-14 05:55:32,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-01-14 05:55:32,227 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-01-14 05:55:32,241 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47523, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-01-14 05:55:32,243 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-01-14 05:55:32,287 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44089] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-01-14 05:55:32,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-01-14 05:55:32,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-01-14 05:55:32,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-01-14 05:55:32,247 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38715, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-01-14 05:55:32,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-01-14 05:55:32,354 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44089] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-01-14 05:55:32,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-01-14 05:55:32,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-01-14 05:55:32,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-01-14 05:55:32,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-01-14 05:55:32,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-01-14 05:55:32,392 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(2833): Master is not running yet 2024-01-14 05:55:32,392 DEBUG [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(2833): Master is not running yet 2024-01-14 05:55:32,392 WARN [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-01-14 05:55:32,393 WARN [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-01-14 05:55:32,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1705211732393,5,FailOnTimeoutGroup] 2024-01-14 05:55:32,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1705211732394,5,FailOnTimeoutGroup] 2024-01-14 05:55:32,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-01-14 05:55:32,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,418 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-01-14 05:55:32,419 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-01-14 05:55:32,420 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd 2024-01-14 05:55:32,439 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:32,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-01-14 05:55:32,444 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/info 2024-01-14 05:55:32,445 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-01-14 05:55:32,446 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:32,447 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-01-14 05:55:32,449 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/rep_barrier 2024-01-14 05:55:32,450 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-01-14 05:55:32,451 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:32,451 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-01-14 05:55:32,453 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/table 2024-01-14 05:55:32,454 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-01-14 05:55:32,455 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:32,457 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740 2024-01-14 05:55:32,458 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740 2024-01-14 05:55:32,462 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-01-14 05:55:32,464 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2024-01-14 05:55:32,469 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 05:55:32,470 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67709863, jitterRate=0.008955582976341248}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-01-14 05:55:32,471 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2024-01-14 05:55:32,471 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-01-14 05:55:32,471 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-01-14 05:55:32,471 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-01-14 05:55:32,471 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-01-14 05:55:32,471 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-01-14 05:55:32,473 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-01-14 05:55:32,473 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-01-14 05:55:32,479 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-01-14 05:55:32,479 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2024-01-14 05:55:32,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-01-14 05:55:32,494 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,44089,1705211729063 with isa=jenkins-hbase4.apache.org/172.31.14.131:35407, startcode=1705211730266 2024-01-14 05:55:32,494 INFO [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,44089,1705211729063 with isa=jenkins-hbase4.apache.org/172.31.14.131:38377, startcode=1705211730222 2024-01-14 05:55:32,500 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44089] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:32,504 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-01-14 05:55:32,507 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44089] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:32,508 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-01-14 05:55:32,509 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd 2024-01-14 05:55:32,509 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:37135 2024-01-14 05:55:32,509 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-01-14 05:55:32,509 DEBUG [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd 2024-01-14 05:55:32,509 DEBUG [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:37135 2024-01-14 05:55:32,509 DEBUG [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-01-14 05:55:32,520 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-14 05:55:32,521 DEBUG [RS:0;jenkins-hbase4:38377] zookeeper.ZKUtil(163): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:32,521 WARN [RS:0;jenkins-hbase4:38377] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-14 05:55:32,522 DEBUG [RS:1;jenkins-hbase4:35407] zookeeper.ZKUtil(163): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:32,522 INFO [RS:0;jenkins-hbase4:38377] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-14 05:55:32,522 WARN [RS:1;jenkins-hbase4:35407] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-14 05:55:32,523 DEBUG [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1951): logDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/WALs/jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:32,523 INFO [RS:1;jenkins-hbase4:35407] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-14 05:55:32,523 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1951): logDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/WALs/jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:32,523 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38377,1705211730222] 2024-01-14 05:55:32,524 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35407,1705211730266] 2024-01-14 05:55:32,535 DEBUG [RS:1;jenkins-hbase4:35407] zookeeper.ZKUtil(163): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:32,535 DEBUG [RS:0;jenkins-hbase4:38377] zookeeper.ZKUtil(163): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:32,536 DEBUG [RS:1;jenkins-hbase4:35407] zookeeper.ZKUtil(163): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:32,537 DEBUG [RS:0;jenkins-hbase4:38377] zookeeper.ZKUtil(163): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:32,548 DEBUG [RS:0;jenkins-hbase4:38377] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-01-14 05:55:32,548 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-01-14 05:55:32,558 INFO [RS:1;jenkins-hbase4:35407] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-01-14 05:55:32,558 INFO [RS:0;jenkins-hbase4:38377] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-01-14 05:55:32,580 INFO [RS:0;jenkins-hbase4:38377] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-01-14 05:55:32,580 INFO [RS:1;jenkins-hbase4:35407] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-01-14 05:55:32,584 INFO [RS:1;jenkins-hbase4:35407] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-01-14 05:55:32,584 INFO [RS:0;jenkins-hbase4:38377] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-01-14 05:55:32,585 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,585 INFO [RS:0;jenkins-hbase4:38377] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,586 INFO [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-01-14 05:55:32,586 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-01-14 05:55:32,595 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,595 INFO [RS:0;jenkins-hbase4:38377] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,595 DEBUG [RS:0;jenkins-hbase4:38377] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,595 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,596 DEBUG [RS:0;jenkins-hbase4:38377] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,596 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,596 DEBUG [RS:0;jenkins-hbase4:38377] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,596 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,596 DEBUG [RS:0;jenkins-hbase4:38377] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,596 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,596 DEBUG [RS:0;jenkins-hbase4:38377] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,597 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,597 DEBUG [RS:0;jenkins-hbase4:38377] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-14 05:55:32,597 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-14 05:55:32,597 DEBUG [RS:0;jenkins-hbase4:38377] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,597 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,597 DEBUG [RS:0;jenkins-hbase4:38377] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,597 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,597 DEBUG [RS:0;jenkins-hbase4:38377] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,597 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,597 DEBUG [RS:0;jenkins-hbase4:38377] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,597 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 05:55:32,599 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,599 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,599 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,599 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,600 INFO [RS:0;jenkins-hbase4:38377] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,600 INFO [RS:0;jenkins-hbase4:38377] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,600 INFO [RS:0;jenkins-hbase4:38377] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,601 INFO [RS:0;jenkins-hbase4:38377] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,617 INFO [RS:0;jenkins-hbase4:38377] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-01-14 05:55:32,617 INFO [RS:1;jenkins-hbase4:35407] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-01-14 05:55:32,621 INFO [RS:0;jenkins-hbase4:38377] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38377,1705211730222-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,621 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35407,1705211730266-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,643 INFO [RS:1;jenkins-hbase4:35407] regionserver.Replication(203): jenkins-hbase4.apache.org,35407,1705211730266 started 2024-01-14 05:55:32,643 INFO [RS:0;jenkins-hbase4:38377] regionserver.Replication(203): jenkins-hbase4.apache.org,38377,1705211730222 started 2024-01-14 05:55:32,643 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,35407,1705211730266, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35407, sessionid=0x1012499f55f0002 2024-01-14 05:55:32,643 INFO [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,38377,1705211730222, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38377, sessionid=0x1012499f55f0001 2024-01-14 05:55:32,644 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-01-14 05:55:32,644 DEBUG [RS:0;jenkins-hbase4:38377] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-01-14 05:55:32,644 DEBUG [RS:1;jenkins-hbase4:35407] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:32,644 DEBUG [RS:0;jenkins-hbase4:38377] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:32,644 DEBUG [RS:1;jenkins-hbase4:35407] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35407,1705211730266' 2024-01-14 05:55:32,644 DEBUG [RS:0;jenkins-hbase4:38377] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38377,1705211730222' 2024-01-14 05:55:32,645 DEBUG [RS:1;jenkins-hbase4:35407] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-01-14 05:55:32,645 DEBUG [RS:0;jenkins-hbase4:38377] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-01-14 05:55:32,646 DEBUG [RS:1;jenkins-hbase4:35407] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-01-14 05:55:32,646 DEBUG [RS:0;jenkins-hbase4:38377] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-01-14 05:55:32,647 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-01-14 05:55:32,647 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-01-14 05:55:32,647 DEBUG [RS:0;jenkins-hbase4:38377] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-01-14 05:55:32,647 DEBUG [RS:1;jenkins-hbase4:35407] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:32,647 DEBUG [RS:0;jenkins-hbase4:38377] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-01-14 05:55:32,647 DEBUG [RS:1;jenkins-hbase4:35407] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35407,1705211730266' 2024-01-14 05:55:32,648 DEBUG [RS:1;jenkins-hbase4:35407] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-01-14 05:55:32,647 DEBUG [RS:0;jenkins-hbase4:38377] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:32,648 DEBUG [RS:0;jenkins-hbase4:38377] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38377,1705211730222' 2024-01-14 05:55:32,648 DEBUG [RS:0;jenkins-hbase4:38377] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-01-14 05:55:32,648 DEBUG [RS:1;jenkins-hbase4:35407] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-01-14 05:55:32,648 DEBUG [RS:0;jenkins-hbase4:38377] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-01-14 05:55:32,649 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-01-14 05:55:32,649 INFO [RS:1;jenkins-hbase4:35407] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-01-14 05:55:32,649 DEBUG [RS:0;jenkins-hbase4:38377] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-01-14 05:55:32,649 INFO [RS:0;jenkins-hbase4:38377] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-01-14 05:55:32,651 INFO [RS:0;jenkins-hbase4:38377] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,651 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,652 DEBUG [RS:0;jenkins-hbase4:38377] zookeeper.ZKUtil(399): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-01-14 05:55:32,652 DEBUG [RS:1;jenkins-hbase4:35407] zookeeper.ZKUtil(399): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-01-14 05:55:32,652 INFO [RS:0;jenkins-hbase4:38377] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-01-14 05:55:32,652 INFO [RS:1;jenkins-hbase4:35407] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-01-14 05:55:32,653 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,653 INFO [RS:0;jenkins-hbase4:38377] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,653 INFO [RS:0;jenkins-hbase4:38377] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,653 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:32,660 DEBUG [jenkins-hbase4:44089] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-01-14 05:55:32,663 DEBUG [jenkins-hbase4:44089] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 05:55:32,670 DEBUG [jenkins-hbase4:44089] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 05:55:32,670 DEBUG [jenkins-hbase4:44089] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 05:55:32,670 DEBUG [jenkins-hbase4:44089] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 05:55:32,672 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38377,1705211730222, state=OPENING 2024-01-14 05:55:32,680 DEBUG [PEWorker-1] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-01-14 05:55:32,682 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 05:55:32,683 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-01-14 05:55:32,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38377,1705211730222}] 2024-01-14 05:55:32,765 INFO [RS:0;jenkins-hbase4:38377] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38377%2C1705211730222, suffix=, logDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/WALs/jenkins-hbase4.apache.org,38377,1705211730222, archiveDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/oldWALs, maxLogs=32 2024-01-14 05:55:32,765 INFO [RS:1;jenkins-hbase4:35407] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35407%2C1705211730266, suffix=, logDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/WALs/jenkins-hbase4.apache.org,35407,1705211730266, archiveDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/oldWALs, maxLogs=32 2024-01-14 05:55:32,789 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33119,DS-37b4ff79-8beb-42f3-a820-a4d318dba4fc,DISK] 2024-01-14 05:55:32,789 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33985,DS-839fde26-5918-4f1f-ba86-921b3ac6db48,DISK] 2024-01-14 05:55:32,789 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33985,DS-839fde26-5918-4f1f-ba86-921b3ac6db48,DISK] 2024-01-14 05:55:32,790 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33119,DS-37b4ff79-8beb-42f3-a820-a4d318dba4fc,DISK] 2024-01-14 05:55:32,817 INFO [RS:1;jenkins-hbase4:35407] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/WALs/jenkins-hbase4.apache.org,35407,1705211730266/jenkins-hbase4.apache.org%2C35407%2C1705211730266.1705211732769 2024-01-14 05:55:32,818 DEBUG [RS:1;jenkins-hbase4:35407] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33119,DS-37b4ff79-8beb-42f3-a820-a4d318dba4fc,DISK], DatanodeInfoWithStorage[127.0.0.1:33985,DS-839fde26-5918-4f1f-ba86-921b3ac6db48,DISK]] 2024-01-14 05:55:32,818 INFO [RS:0;jenkins-hbase4:38377] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/WALs/jenkins-hbase4.apache.org,38377,1705211730222/jenkins-hbase4.apache.org%2C38377%2C1705211730222.1705211732769 2024-01-14 05:55:32,819 DEBUG [RS:0;jenkins-hbase4:38377] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33985,DS-839fde26-5918-4f1f-ba86-921b3ac6db48,DISK], DatanodeInfoWithStorage[127.0.0.1:33119,DS-37b4ff79-8beb-42f3-a820-a4d318dba4fc,DISK]] 2024-01-14 05:55:32,869 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:32,872 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-01-14 05:55:32,875 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-01-14 05:55:32,886 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-01-14 05:55:32,887 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-14 05:55:32,890 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38377%2C1705211730222.meta, suffix=.meta, logDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/WALs/jenkins-hbase4.apache.org,38377,1705211730222, archiveDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/oldWALs, maxLogs=32 2024-01-14 05:55:32,909 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33119,DS-37b4ff79-8beb-42f3-a820-a4d318dba4fc,DISK] 2024-01-14 05:55:32,910 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33985,DS-839fde26-5918-4f1f-ba86-921b3ac6db48,DISK] 2024-01-14 05:55:32,917 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/WALs/jenkins-hbase4.apache.org,38377,1705211730222/jenkins-hbase4.apache.org%2C38377%2C1705211730222.meta.1705211732892.meta 2024-01-14 05:55:32,918 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33119,DS-37b4ff79-8beb-42f3-a820-a4d318dba4fc,DISK], DatanodeInfoWithStorage[127.0.0.1:33985,DS-839fde26-5918-4f1f-ba86-921b3ac6db48,DISK]] 2024-01-14 05:55:32,918 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-01-14 05:55:32,920 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-01-14 05:55:32,945 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-01-14 05:55:32,950 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-01-14 05:55:32,957 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-01-14 05:55:32,957 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:32,958 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-01-14 05:55:32,958 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-01-14 05:55:32,961 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-01-14 05:55:32,963 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/info 2024-01-14 05:55:32,963 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/info 2024-01-14 05:55:32,964 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-01-14 05:55:32,965 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:32,965 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-01-14 05:55:32,966 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/rep_barrier 2024-01-14 05:55:32,966 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/rep_barrier 2024-01-14 05:55:32,967 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-01-14 05:55:32,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:32,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-01-14 05:55:32,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/table 2024-01-14 05:55:32,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/table 2024-01-14 05:55:32,970 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-01-14 05:55:32,970 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:32,972 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740 2024-01-14 05:55:32,975 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740 2024-01-14 05:55:32,978 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-01-14 05:55:32,980 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-01-14 05:55:32,982 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60779834, jitterRate=-0.09430989623069763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-01-14 05:55:32,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-01-14 05:55:32,993 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1705211732862 2024-01-14 05:55:33,011 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:meta,,1.1588230740 2024-01-14 05:55:33,012 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-01-14 05:55:33,013 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38377,1705211730222, state=OPEN 2024-01-14 05:55:33,016 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-01-14 05:55:33,016 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-01-14 05:55:33,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-01-14 05:55:33,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38377,1705211730222 in 330 msec 2024-01-14 05:55:33,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-01-14 05:55:33,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 535 msec 2024-01-14 05:55:33,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2110 sec 2024-01-14 05:55:33,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1705211733032, completionTime=-1 2024-01-14 05:55:33,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-01-14 05:55:33,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-01-14 05:55:33,096 DEBUG [hconnection-0x5aba4ae5-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-14 05:55:33,099 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-14 05:55:33,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-01-14 05:55:33,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1705211793118 2024-01-14 05:55:33,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1705211853118 2024-01-14 05:55:33,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 85 msec 2024-01-14 05:55:33,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44089,1705211729063-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:33,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44089,1705211729063-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:33,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44089,1705211729063-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:33,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44089, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:33,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:33,154 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-01-14 05:55:33,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-01-14 05:55:33,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-01-14 05:55:33,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-01-14 05:55:33,175 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-01-14 05:55:33,178 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-14 05:55:33,199 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b 2024-01-14 05:55:33,201 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b empty. 2024-01-14 05:55:33,202 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b 2024-01-14 05:55:33,202 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-01-14 05:55:33,230 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-01-14 05:55:33,232 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e77cee140062c8412e5f5133ddfffd6b, NAME => 'hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp 2024-01-14 05:55:33,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:33,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e77cee140062c8412e5f5133ddfffd6b, disabling compactions & flushes 2024-01-14 05:55:33,250 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. 2024-01-14 05:55:33,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. 2024-01-14 05:55:33,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. after waiting 0 ms 2024-01-14 05:55:33,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. 2024-01-14 05:55:33,250 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. 2024-01-14 05:55:33,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e77cee140062c8412e5f5133ddfffd6b: 2024-01-14 05:55:33,254 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-01-14 05:55:33,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1705211733257"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705211733257"}]},"ts":"1705211733257"} 2024-01-14 05:55:33,296 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-14 05:55:33,298 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-14 05:55:33,303 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211733298"}]},"ts":"1705211733298"} 2024-01-14 05:55:33,306 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-01-14 05:55:33,311 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 05:55:33,313 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 05:55:33,313 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 05:55:33,313 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 05:55:33,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e77cee140062c8412e5f5133ddfffd6b, ASSIGN}] 2024-01-14 05:55:33,318 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e77cee140062c8412e5f5133ddfffd6b, ASSIGN 2024-01-14 05:55:33,320 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e77cee140062c8412e5f5133ddfffd6b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38377,1705211730222; forceNewPlan=false, retain=false 2024-01-14 05:55:33,473 INFO [jenkins-hbase4:44089] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-14 05:55:33,473 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e77cee140062c8412e5f5133ddfffd6b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:33,474 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1705211733473"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705211733473"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705211733473"}]},"ts":"1705211733473"} 2024-01-14 05:55:33,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e77cee140062c8412e5f5133ddfffd6b, server=jenkins-hbase4.apache.org,38377,1705211730222}] 2024-01-14 05:55:33,633 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:33,641 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. 2024-01-14 05:55:33,641 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e77cee140062c8412e5f5133ddfffd6b, NAME => 'hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b.', STARTKEY => '', ENDKEY => ''} 2024-01-14 05:55:33,642 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e77cee140062c8412e5f5133ddfffd6b 2024-01-14 05:55:33,643 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:33,643 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e77cee140062c8412e5f5133ddfffd6b 2024-01-14 05:55:33,643 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e77cee140062c8412e5f5133ddfffd6b 2024-01-14 05:55:33,648 INFO [StoreOpener-e77cee140062c8412e5f5133ddfffd6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e77cee140062c8412e5f5133ddfffd6b 2024-01-14 05:55:33,650 DEBUG [StoreOpener-e77cee140062c8412e5f5133ddfffd6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b/info 2024-01-14 05:55:33,651 DEBUG [StoreOpener-e77cee140062c8412e5f5133ddfffd6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b/info 2024-01-14 05:55:33,651 INFO [StoreOpener-e77cee140062c8412e5f5133ddfffd6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e77cee140062c8412e5f5133ddfffd6b columnFamilyName info 2024-01-14 05:55:33,652 INFO [StoreOpener-e77cee140062c8412e5f5133ddfffd6b-1] regionserver.HStore(310): Store=e77cee140062c8412e5f5133ddfffd6b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:33,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b 2024-01-14 05:55:33,654 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b 2024-01-14 05:55:33,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e77cee140062c8412e5f5133ddfffd6b 2024-01-14 05:55:33,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 05:55:33,664 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e77cee140062c8412e5f5133ddfffd6b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67142700, jitterRate=5.041956901550293E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 05:55:33,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e77cee140062c8412e5f5133ddfffd6b: 2024-01-14 05:55:33,666 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b., pid=6, masterSystemTime=1705211733633 2024-01-14 05:55:33,669 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. 2024-01-14 05:55:33,669 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. 2024-01-14 05:55:33,671 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e77cee140062c8412e5f5133ddfffd6b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:33,671 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1705211733670"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705211733670"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705211733670"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705211733670"}]},"ts":"1705211733670"} 2024-01-14 05:55:33,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-01-14 05:55:33,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e77cee140062c8412e5f5133ddfffd6b, server=jenkins-hbase4.apache.org,38377,1705211730222 in 195 msec 2024-01-14 05:55:33,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-01-14 05:55:33,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e77cee140062c8412e5f5133ddfffd6b, ASSIGN in 364 msec 2024-01-14 05:55:33,684 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-14 05:55:33,684 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211733684"}]},"ts":"1705211733684"} 2024-01-14 05:55:33,687 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-01-14 05:55:33,691 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-01-14 05:55:33,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 527 msec 2024-01-14 05:55:33,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-01-14 05:55:33,778 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-01-14 05:55:33,778 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 05:55:33,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-01-14 05:55:33,831 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-14 05:55:33,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2024-01-14 05:55:33,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-01-14 05:55:33,857 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-14 05:55:33,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2024-01-14 05:55:33,871 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-01-14 05:55:33,874 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-01-14 05:55:33,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 3.547sec 2024-01-14 05:55:33,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-01-14 05:55:33,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-14 05:55:33,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-01-14 05:55:33,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-01-14 05:55:33,881 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-01-14 05:55:33,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-01-14 05:55:33,883 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-14 05:55:33,885 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:55:33,886 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279 empty. 2024-01-14 05:55:33,888 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:55:33,888 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-01-14 05:55:33,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-01-14 05:55:33,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-01-14 05:55:33,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:33,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:33,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-01-14 05:55:33,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-01-14 05:55:33,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44089,1705211729063-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-01-14 05:55:33,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44089,1705211729063-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-01-14 05:55:33,910 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-01-14 05:55:33,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44089,1705211729063-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 05:55:33,915 DEBUG [Listener at localhost/35313] zookeeper.ReadOnlyZKClient(139): Connect 0x08b1db53 to 127.0.0.1:52071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-14 05:55:33,918 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-01-14 05:55:33,921 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 429487984ddaf9a6bdc704a947dc5279, NAME => 'hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp 2024-01-14 05:55:33,921 DEBUG [Listener at localhost/35313] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8751431, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-14 05:55:33,948 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:33,948 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 429487984ddaf9a6bdc704a947dc5279, disabling compactions & flushes 2024-01-14 05:55:33,949 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. 2024-01-14 05:55:33,949 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. 2024-01-14 05:55:33,949 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. after waiting 0 ms 2024-01-14 05:55:33,949 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. 2024-01-14 05:55:33,949 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. 2024-01-14 05:55:33,949 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 429487984ddaf9a6bdc704a947dc5279: 2024-01-14 05:55:33,950 DEBUG [hconnection-0x5bdc1c43-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-14 05:55:33,954 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-01-14 05:55:33,956 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1705211733956"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705211733956"}]},"ts":"1705211733956"} 2024-01-14 05:55:33,959 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-14 05:55:33,961 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-14 05:55:33,961 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211733961"}]},"ts":"1705211733961"} 2024-01-14 05:55:33,963 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-01-14 05:55:33,965 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-14 05:55:33,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 05:55:33,970 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 05:55:33,970 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 05:55:33,970 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 05:55:33,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=429487984ddaf9a6bdc704a947dc5279, ASSIGN}] 2024-01-14 05:55:33,972 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=429487984ddaf9a6bdc704a947dc5279, ASSIGN 2024-01-14 05:55:33,974 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=429487984ddaf9a6bdc704a947dc5279, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38377,1705211730222; forceNewPlan=false, retain=false 2024-01-14 05:55:33,976 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44089,1705211729063 2024-01-14 05:55:33,978 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:33,981 DEBUG [Listener at localhost/35313] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-14 05:55:34,084 DEBUG [Listener at localhost/35313] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-14 05:55:34,124 INFO [jenkins-hbase4:44089] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-14 05:55:34,125 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=429487984ddaf9a6bdc704a947dc5279, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:34,125 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1705211734125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705211734125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705211734125"}]},"ts":"1705211734125"} 2024-01-14 05:55:34,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 429487984ddaf9a6bdc704a947dc5279, server=jenkins-hbase4.apache.org,38377,1705211730222}] 2024-01-14 05:55:34,186 DEBUG [Listener at localhost/35313] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-14 05:55:34,281 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:34,287 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. 2024-01-14 05:55:34,287 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 429487984ddaf9a6bdc704a947dc5279, NAME => 'hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279.', STARTKEY => '', ENDKEY => ''} 2024-01-14 05:55:34,287 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:55:34,287 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:34,287 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:55:34,287 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:55:34,288 DEBUG [Listener at localhost/35313] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-14 05:55:34,289 INFO [StoreOpener-429487984ddaf9a6bdc704a947dc5279-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:55:34,291 DEBUG [StoreOpener-429487984ddaf9a6bdc704a947dc5279-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/q 2024-01-14 05:55:34,292 DEBUG [StoreOpener-429487984ddaf9a6bdc704a947dc5279-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/q 2024-01-14 05:55:34,292 INFO [StoreOpener-429487984ddaf9a6bdc704a947dc5279-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 429487984ddaf9a6bdc704a947dc5279 columnFamilyName q 2024-01-14 05:55:34,293 INFO [StoreOpener-429487984ddaf9a6bdc704a947dc5279-1] regionserver.HStore(310): Store=429487984ddaf9a6bdc704a947dc5279/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:34,293 INFO [StoreOpener-429487984ddaf9a6bdc704a947dc5279-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:55:34,295 DEBUG [StoreOpener-429487984ddaf9a6bdc704a947dc5279-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/u 2024-01-14 05:55:34,295 DEBUG [StoreOpener-429487984ddaf9a6bdc704a947dc5279-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/u 2024-01-14 05:55:34,296 INFO [StoreOpener-429487984ddaf9a6bdc704a947dc5279-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 429487984ddaf9a6bdc704a947dc5279 columnFamilyName u 2024-01-14 05:55:34,297 INFO [StoreOpener-429487984ddaf9a6bdc704a947dc5279-1] regionserver.HStore(310): Store=429487984ddaf9a6bdc704a947dc5279/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:34,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:55:34,299 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:55:34,302 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-01-14 05:55:34,304 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:55:34,307 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 05:55:34,308 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 429487984ddaf9a6bdc704a947dc5279; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63042019, jitterRate=-0.06060071289539337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-01-14 05:55:34,308 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 429487984ddaf9a6bdc704a947dc5279: 2024-01-14 05:55:34,309 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279., pid=11, masterSystemTime=1705211734281 2024-01-14 05:55:34,312 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. 2024-01-14 05:55:34,312 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. 2024-01-14 05:55:34,313 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=429487984ddaf9a6bdc704a947dc5279, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:34,313 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1705211734313"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705211734313"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705211734313"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705211734313"}]},"ts":"1705211734313"} 2024-01-14 05:55:34,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-01-14 05:55:34,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 429487984ddaf9a6bdc704a947dc5279, server=jenkins-hbase4.apache.org,38377,1705211730222 in 188 msec 2024-01-14 05:55:34,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-01-14 05:55:34,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=429487984ddaf9a6bdc704a947dc5279, ASSIGN in 349 msec 2024-01-14 05:55:34,324 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-14 05:55:34,324 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211734324"}]},"ts":"1705211734324"} 2024-01-14 05:55:34,326 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-01-14 05:55:34,331 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-01-14 05:55:34,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 453 msec 2024-01-14 05:55:34,401 DEBUG [Listener at localhost/35313] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-14 05:55:34,404 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-01-14 05:55:34,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-14 05:55:34,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-01-14 05:55:34,436 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-14 05:55:34,438 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-14 05:55:34,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-01-14 05:55:34,441 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:55:34,442 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c empty. 2024-01-14 05:55:34,442 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:55:34,442 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-01-14 05:55:34,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-14 05:55:34,462 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-01-14 05:55:34,463 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => e4945af9a1f5d597b58c8c0bd75f106c, NAME => 'TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp 2024-01-14 05:55:34,480 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:34,480 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing e4945af9a1f5d597b58c8c0bd75f106c, disabling compactions & flushes 2024-01-14 05:55:34,480 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. 2024-01-14 05:55:34,480 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. 2024-01-14 05:55:34,480 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. after waiting 0 ms 2024-01-14 05:55:34,480 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. 2024-01-14 05:55:34,480 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. 2024-01-14 05:55:34,480 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for e4945af9a1f5d597b58c8c0bd75f106c: 2024-01-14 05:55:34,485 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-01-14 05:55:34,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211734486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705211734486"}]},"ts":"1705211734486"} 2024-01-14 05:55:34,489 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-14 05:55:34,491 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-14 05:55:34,491 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211734491"}]},"ts":"1705211734491"} 2024-01-14 05:55:34,493 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-01-14 05:55:34,497 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 05:55:34,498 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 05:55:34,498 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 05:55:34,499 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 05:55:34,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=e4945af9a1f5d597b58c8c0bd75f106c, ASSIGN}] 2024-01-14 05:55:34,500 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=e4945af9a1f5d597b58c8c0bd75f106c, ASSIGN 2024-01-14 05:55:34,502 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=e4945af9a1f5d597b58c8c0bd75f106c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35407,1705211730266; forceNewPlan=false, retain=false 2024-01-14 05:55:34,652 INFO [jenkins-hbase4:44089] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-14 05:55:34,653 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e4945af9a1f5d597b58c8c0bd75f106c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:34,653 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211734653"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705211734653"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705211734653"}]},"ts":"1705211734653"} 2024-01-14 05:55:34,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure e4945af9a1f5d597b58c8c0bd75f106c, server=jenkins-hbase4.apache.org,35407,1705211730266}] 2024-01-14 05:55:34,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-14 05:55:34,810 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:34,811 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-01-14 05:55:34,814 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-01-14 05:55:34,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. 2024-01-14 05:55:34,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4945af9a1f5d597b58c8c0bd75f106c, NAME => 'TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c.', STARTKEY => '', ENDKEY => ''} 2024-01-14 05:55:34,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:55:34,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:34,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:55:34,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:55:34,822 INFO [StoreOpener-e4945af9a1f5d597b58c8c0bd75f106c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:55:34,825 DEBUG [StoreOpener-e4945af9a1f5d597b58c8c0bd75f106c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/cf 2024-01-14 05:55:34,825 DEBUG [StoreOpener-e4945af9a1f5d597b58c8c0bd75f106c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/cf 2024-01-14 05:55:34,825 INFO [StoreOpener-e4945af9a1f5d597b58c8c0bd75f106c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4945af9a1f5d597b58c8c0bd75f106c columnFamilyName cf 2024-01-14 05:55:34,826 INFO [StoreOpener-e4945af9a1f5d597b58c8c0bd75f106c-1] regionserver.HStore(310): Store=e4945af9a1f5d597b58c8c0bd75f106c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:34,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:55:34,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:55:34,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:55:34,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 05:55:34,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4945af9a1f5d597b58c8c0bd75f106c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67105393, jitterRate=-5.1721930503845215E-5}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 05:55:34,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4945af9a1f5d597b58c8c0bd75f106c: 2024-01-14 05:55:34,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c., pid=14, masterSystemTime=1705211734810 2024-01-14 05:55:34,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. 2024-01-14 05:55:34,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. 2024-01-14 05:55:34,844 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e4945af9a1f5d597b58c8c0bd75f106c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:34,844 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211734844"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705211734844"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705211734844"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705211734844"}]},"ts":"1705211734844"} 2024-01-14 05:55:34,850 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-01-14 05:55:34,850 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure e4945af9a1f5d597b58c8c0bd75f106c, server=jenkins-hbase4.apache.org,35407,1705211730266 in 190 msec 2024-01-14 05:55:34,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-01-14 05:55:34,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=e4945af9a1f5d597b58c8c0bd75f106c, ASSIGN in 351 msec 2024-01-14 05:55:34,855 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-14 05:55:34,855 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211734855"}]},"ts":"1705211734855"} 2024-01-14 05:55:34,858 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-01-14 05:55:34,861 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-01-14 05:55:34,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 429 msec 2024-01-14 05:55:35,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-14 05:55:35,206 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-01-14 05:55:35,206 DEBUG [Listener at localhost/35313] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-01-14 05:55:35,207 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:35,211 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-01-14 05:55:35,212 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:35,212 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-01-14 05:55:35,212 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:35,221 DEBUG [hconnection-0x5bdc1c43-shared-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-14 05:55:35,224 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-14 05:55:35,229 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-14 05:55:35,231 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-01-14 05:55:35,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-14 05:55:35,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-01-14 05:55:35,236 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-14 05:55:35,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-01-14 05:55:35,238 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-14 05:55:35,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-14 05:55:35,240 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498 2024-01-14 05:55:35,241 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498 empty. 2024-01-14 05:55:35,242 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498 2024-01-14 05:55:35,242 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-01-14 05:55:35,260 WARN [DataStreamer for file /user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin1/.tmp/.tableinfo.0000000001] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2024-01-14 05:55:35,262 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-01-14 05:55:35,264 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1a2803835415b06960721578e6ae3498, NAME => 'TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp 2024-01-14 05:55:35,277 DEBUG [hconnection-0xb3340f2-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-14 05:55:35,280 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2024-01-14 05:55:35,280 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:35,281 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 1a2803835415b06960721578e6ae3498, disabling compactions & flushes 2024-01-14 05:55:35,281 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. 2024-01-14 05:55:35,281 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. 2024-01-14 05:55:35,281 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. after waiting 0 ms 2024-01-14 05:55:35,281 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. 2024-01-14 05:55:35,281 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. 2024-01-14 05:55:35,281 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 1a2803835415b06960721578e6ae3498: 2024-01-14 05:55:35,287 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-01-14 05:55:35,288 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211735288"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705211735288"}]},"ts":"1705211735288"} 2024-01-14 05:55:35,292 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-14 05:55:35,293 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-14 05:55:35,293 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211735293"}]},"ts":"1705211735293"} 2024-01-14 05:55:35,295 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-01-14 05:55:35,301 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 05:55:35,302 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 05:55:35,302 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 05:55:35,302 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 05:55:35,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=1a2803835415b06960721578e6ae3498, ASSIGN}] 2024-01-14 05:55:35,304 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=1a2803835415b06960721578e6ae3498, ASSIGN 2024-01-14 05:55:35,305 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=1a2803835415b06960721578e6ae3498, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35407,1705211730266; forceNewPlan=false, retain=false 2024-01-14 05:55:35,456 INFO [jenkins-hbase4:44089] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-14 05:55:35,457 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1a2803835415b06960721578e6ae3498, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:35,457 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211735457"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705211735457"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705211735457"}]},"ts":"1705211735457"} 2024-01-14 05:55:35,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 1a2803835415b06960721578e6ae3498, server=jenkins-hbase4.apache.org,35407,1705211730266}] 2024-01-14 05:55:35,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-14 05:55:35,613 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:35,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. 2024-01-14 05:55:35,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a2803835415b06960721578e6ae3498, NAME => 'TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498.', STARTKEY => '', ENDKEY => ''} 2024-01-14 05:55:35,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 1a2803835415b06960721578e6ae3498 2024-01-14 05:55:35,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:35,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1a2803835415b06960721578e6ae3498 2024-01-14 05:55:35,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1a2803835415b06960721578e6ae3498 2024-01-14 05:55:35,621 INFO [StoreOpener-1a2803835415b06960721578e6ae3498-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1a2803835415b06960721578e6ae3498 2024-01-14 05:55:35,623 DEBUG [StoreOpener-1a2803835415b06960721578e6ae3498-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498/cf 2024-01-14 05:55:35,623 DEBUG [StoreOpener-1a2803835415b06960721578e6ae3498-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498/cf 2024-01-14 05:55:35,624 INFO [StoreOpener-1a2803835415b06960721578e6ae3498-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a2803835415b06960721578e6ae3498 columnFamilyName cf 2024-01-14 05:55:35,625 INFO [StoreOpener-1a2803835415b06960721578e6ae3498-1] regionserver.HStore(310): Store=1a2803835415b06960721578e6ae3498/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:35,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498 2024-01-14 05:55:35,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498 2024-01-14 05:55:35,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1a2803835415b06960721578e6ae3498 2024-01-14 05:55:35,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 05:55:35,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1a2803835415b06960721578e6ae3498; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63072676, jitterRate=-0.060143887996673584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 05:55:35,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1a2803835415b06960721578e6ae3498: 2024-01-14 05:55:35,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498., pid=17, masterSystemTime=1705211735613 2024-01-14 05:55:35,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. 2024-01-14 05:55:35,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. 2024-01-14 05:55:35,645 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1a2803835415b06960721578e6ae3498, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:35,646 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211735645"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705211735645"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705211735645"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705211735645"}]},"ts":"1705211735645"} 2024-01-14 05:55:35,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-01-14 05:55:35,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 1a2803835415b06960721578e6ae3498, server=jenkins-hbase4.apache.org,35407,1705211730266 in 188 msec 2024-01-14 05:55:35,653 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-01-14 05:55:35,655 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=1a2803835415b06960721578e6ae3498, ASSIGN in 349 msec 2024-01-14 05:55:35,656 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-14 05:55:35,657 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211735656"}]},"ts":"1705211735656"} 2024-01-14 05:55:35,658 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-01-14 05:55:35,662 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-01-14 05:55:35,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 429 msec 2024-01-14 05:55:35,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-14 05:55:35,993 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-01-14 05:55:35,993 DEBUG [Listener at localhost/35313] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-01-14 05:55:35,993 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:35,997 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-01-14 05:55:35,997 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:35,997 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-01-14 05:55:35,997 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:36,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-14 05:55:36,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-01-14 05:55:36,013 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-14 05:55:36,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-01-14 05:55:36,014 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-14 05:55:36,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-14 05:55:36,016 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:55:36,017 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385 empty. 2024-01-14 05:55:36,018 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:55:36,018 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-01-14 05:55:36,038 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-01-14 05:55:36,039 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0a86fbc5c7674f2fd4e51feea61e8385, NAME => 'TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp 2024-01-14 05:55:36,053 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:36,053 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 0a86fbc5c7674f2fd4e51feea61e8385, disabling compactions & flushes 2024-01-14 05:55:36,053 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. 2024-01-14 05:55:36,053 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. 2024-01-14 05:55:36,053 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. after waiting 0 ms 2024-01-14 05:55:36,053 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. 2024-01-14 05:55:36,053 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. 2024-01-14 05:55:36,053 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 0a86fbc5c7674f2fd4e51feea61e8385: 2024-01-14 05:55:36,057 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-01-14 05:55:36,059 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211736058"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705211736058"}]},"ts":"1705211736058"} 2024-01-14 05:55:36,061 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-14 05:55:36,062 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-14 05:55:36,063 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211736062"}]},"ts":"1705211736062"} 2024-01-14 05:55:36,065 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-01-14 05:55:36,071 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 05:55:36,072 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 05:55:36,073 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 05:55:36,073 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 05:55:36,073 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0a86fbc5c7674f2fd4e51feea61e8385, ASSIGN}] 2024-01-14 05:55:36,074 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0a86fbc5c7674f2fd4e51feea61e8385, ASSIGN 2024-01-14 05:55:36,076 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0a86fbc5c7674f2fd4e51feea61e8385, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38377,1705211730222; forceNewPlan=false, retain=false 2024-01-14 05:55:36,226 INFO [jenkins-hbase4:44089] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-14 05:55:36,227 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0a86fbc5c7674f2fd4e51feea61e8385, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:36,228 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211736227"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705211736227"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705211736227"}]},"ts":"1705211736227"} 2024-01-14 05:55:36,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 0a86fbc5c7674f2fd4e51feea61e8385, server=jenkins-hbase4.apache.org,38377,1705211730222}] 2024-01-14 05:55:36,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-14 05:55:36,383 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:36,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. 2024-01-14 05:55:36,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a86fbc5c7674f2fd4e51feea61e8385, NAME => 'TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385.', STARTKEY => '', ENDKEY => ''} 2024-01-14 05:55:36,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:55:36,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:36,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:55:36,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:55:36,392 INFO [StoreOpener-0a86fbc5c7674f2fd4e51feea61e8385-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:55:36,395 DEBUG [StoreOpener-0a86fbc5c7674f2fd4e51feea61e8385-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385/cf 2024-01-14 05:55:36,395 DEBUG [StoreOpener-0a86fbc5c7674f2fd4e51feea61e8385-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385/cf 2024-01-14 05:55:36,395 INFO [StoreOpener-0a86fbc5c7674f2fd4e51feea61e8385-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a86fbc5c7674f2fd4e51feea61e8385 columnFamilyName cf 2024-01-14 05:55:36,396 INFO [StoreOpener-0a86fbc5c7674f2fd4e51feea61e8385-1] regionserver.HStore(310): Store=0a86fbc5c7674f2fd4e51feea61e8385/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:36,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:55:36,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:55:36,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:55:36,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 05:55:36,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a86fbc5c7674f2fd4e51feea61e8385; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61732740, jitterRate=-0.08011049032211304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 05:55:36,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a86fbc5c7674f2fd4e51feea61e8385: 2024-01-14 05:55:36,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385., pid=20, masterSystemTime=1705211736383 2024-01-14 05:55:36,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. 2024-01-14 05:55:36,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. 2024-01-14 05:55:36,411 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0a86fbc5c7674f2fd4e51feea61e8385, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:36,411 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211736410"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705211736410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705211736410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705211736410"}]},"ts":"1705211736410"} 2024-01-14 05:55:36,416 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-01-14 05:55:36,416 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 0a86fbc5c7674f2fd4e51feea61e8385, server=jenkins-hbase4.apache.org,38377,1705211730222 in 183 msec 2024-01-14 05:55:36,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-01-14 05:55:36,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0a86fbc5c7674f2fd4e51feea61e8385, ASSIGN in 343 msec 2024-01-14 05:55:36,420 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-14 05:55:36,421 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211736420"}]},"ts":"1705211736420"} 2024-01-14 05:55:36,422 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-01-14 05:55:36,426 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-01-14 05:55:36,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 417 msec 2024-01-14 05:55:36,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-14 05:55:36,769 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-01-14 05:55:36,769 DEBUG [Listener at localhost/35313] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-01-14 05:55:36,769 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:36,772 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-01-14 05:55:36,772 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:36,773 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-01-14 05:55:36,773 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:36,782 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-14 05:55:36,786 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-01-14 05:55:36,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-01-14 05:55:36,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-01-14 05:55:36,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-01-14 05:55:36,807 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-14 05:55:36,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 20 msec 2024-01-14 05:55:37,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-01-14 05:55:37,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-14 05:55:37,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-01-14 05:55:37,057 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-01-14 05:55:37,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-01-14 05:55:37,059 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-14 05:55:37,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-14 05:55:37,062 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776 2024-01-14 05:55:37,062 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4 2024-01-14 05:55:37,063 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4 empty. 2024-01-14 05:55:37,064 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776 empty. 2024-01-14 05:55:37,064 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4 2024-01-14 05:55:37,064 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776 2024-01-14 05:55:37,064 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-01-14 05:55:37,081 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-01-14 05:55:37,083 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 91ffecf3af843307d3744fa2072e9776, NAME => 'TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp 2024-01-14 05:55:37,084 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => d45c4e1d53988929334afb608fa224c4, NAME => 'TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp 2024-01-14 05:55:37,106 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:37,106 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing d45c4e1d53988929334afb608fa224c4, disabling compactions & flushes 2024-01-14 05:55:37,106 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. 2024-01-14 05:55:37,106 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. 2024-01-14 05:55:37,106 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. after waiting 0 ms 2024-01-14 05:55:37,106 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. 2024-01-14 05:55:37,106 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. 2024-01-14 05:55:37,106 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:37,106 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for d45c4e1d53988929334afb608fa224c4: 2024-01-14 05:55:37,107 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 91ffecf3af843307d3744fa2072e9776, disabling compactions & flushes 2024-01-14 05:55:37,107 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. 2024-01-14 05:55:37,107 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. 2024-01-14 05:55:37,107 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. after waiting 0 ms 2024-01-14 05:55:37,107 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. 2024-01-14 05:55:37,107 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. 2024-01-14 05:55:37,107 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 91ffecf3af843307d3744fa2072e9776: 2024-01-14 05:55:37,111 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-01-14 05:55:37,113 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705211737112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705211737112"}]},"ts":"1705211737112"} 2024-01-14 05:55:37,113 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705211737112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705211737112"}]},"ts":"1705211737112"} 2024-01-14 05:55:37,117 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-01-14 05:55:37,118 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-14 05:55:37,118 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211737118"}]},"ts":"1705211737118"} 2024-01-14 05:55:37,120 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-01-14 05:55:37,125 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 05:55:37,127 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 05:55:37,127 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 05:55:37,127 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 05:55:37,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=91ffecf3af843307d3744fa2072e9776, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=d45c4e1d53988929334afb608fa224c4, ASSIGN}] 2024-01-14 05:55:37,129 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=d45c4e1d53988929334afb608fa224c4, ASSIGN 2024-01-14 05:55:37,129 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=91ffecf3af843307d3744fa2072e9776, ASSIGN 2024-01-14 05:55:37,130 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=d45c4e1d53988929334afb608fa224c4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35407,1705211730266; forceNewPlan=false, retain=false 2024-01-14 05:55:37,130 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=91ffecf3af843307d3744fa2072e9776, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38377,1705211730222; forceNewPlan=false, retain=false 2024-01-14 05:55:37,280 INFO [jenkins-hbase4:44089] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-01-14 05:55:37,282 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=d45c4e1d53988929334afb608fa224c4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:37,282 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=91ffecf3af843307d3744fa2072e9776, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:37,282 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705211737282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705211737282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705211737282"}]},"ts":"1705211737282"} 2024-01-14 05:55:37,282 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705211737282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705211737282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705211737282"}]},"ts":"1705211737282"} 2024-01-14 05:55:37,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure d45c4e1d53988929334afb608fa224c4, server=jenkins-hbase4.apache.org,35407,1705211730266}] 2024-01-14 05:55:37,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=23, state=RUNNABLE; OpenRegionProcedure 91ffecf3af843307d3744fa2072e9776, server=jenkins-hbase4.apache.org,38377,1705211730222}] 2024-01-14 05:55:37,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-14 05:55:37,438 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:37,440 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:37,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. 2024-01-14 05:55:37,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d45c4e1d53988929334afb608fa224c4, NAME => 'TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4.', STARTKEY => '1', ENDKEY => ''} 2024-01-14 05:55:37,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. 2024-01-14 05:55:37,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91ffecf3af843307d3744fa2072e9776, NAME => 'TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776.', STARTKEY => '', ENDKEY => '1'} 2024-01-14 05:55:37,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable d45c4e1d53988929334afb608fa224c4 2024-01-14 05:55:37,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:37,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d45c4e1d53988929334afb608fa224c4 2024-01-14 05:55:37,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 91ffecf3af843307d3744fa2072e9776 2024-01-14 05:55:37,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d45c4e1d53988929334afb608fa224c4 2024-01-14 05:55:37,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 05:55:37,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 91ffecf3af843307d3744fa2072e9776 2024-01-14 05:55:37,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 91ffecf3af843307d3744fa2072e9776 2024-01-14 05:55:37,448 INFO [StoreOpener-d45c4e1d53988929334afb608fa224c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d45c4e1d53988929334afb608fa224c4 2024-01-14 05:55:37,449 INFO [StoreOpener-91ffecf3af843307d3744fa2072e9776-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 91ffecf3af843307d3744fa2072e9776 2024-01-14 05:55:37,451 DEBUG [StoreOpener-d45c4e1d53988929334afb608fa224c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4/cf 2024-01-14 05:55:37,451 DEBUG [StoreOpener-d45c4e1d53988929334afb608fa224c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4/cf 2024-01-14 05:55:37,451 INFO [StoreOpener-d45c4e1d53988929334afb608fa224c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d45c4e1d53988929334afb608fa224c4 columnFamilyName cf 2024-01-14 05:55:37,452 INFO [StoreOpener-d45c4e1d53988929334afb608fa224c4-1] regionserver.HStore(310): Store=d45c4e1d53988929334afb608fa224c4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:37,452 DEBUG [StoreOpener-91ffecf3af843307d3744fa2072e9776-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776/cf 2024-01-14 05:55:37,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4 2024-01-14 05:55:37,457 DEBUG [StoreOpener-91ffecf3af843307d3744fa2072e9776-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776/cf 2024-01-14 05:55:37,458 INFO [StoreOpener-91ffecf3af843307d3744fa2072e9776-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91ffecf3af843307d3744fa2072e9776 columnFamilyName cf 2024-01-14 05:55:37,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4 2024-01-14 05:55:37,458 INFO [StoreOpener-91ffecf3af843307d3744fa2072e9776-1] regionserver.HStore(310): Store=91ffecf3af843307d3744fa2072e9776/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 05:55:37,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776 2024-01-14 05:55:37,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776 2024-01-14 05:55:37,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d45c4e1d53988929334afb608fa224c4 2024-01-14 05:55:37,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 91ffecf3af843307d3744fa2072e9776 2024-01-14 05:55:37,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 05:55:37,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d45c4e1d53988929334afb608fa224c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69215585, jitterRate=0.03139258921146393}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 05:55:37,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d45c4e1d53988929334afb608fa224c4: 2024-01-14 05:55:37,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4., pid=25, masterSystemTime=1705211737438 2024-01-14 05:55:37,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 05:55:37,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 91ffecf3af843307d3744fa2072e9776; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69316352, jitterRate=0.032894134521484375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 05:55:37,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 91ffecf3af843307d3744fa2072e9776: 2024-01-14 05:55:37,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776., pid=26, masterSystemTime=1705211737440 2024-01-14 05:55:37,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. 2024-01-14 05:55:37,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. 2024-01-14 05:55:37,473 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=d45c4e1d53988929334afb608fa224c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:55:37,473 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705211737472"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705211737472"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705211737472"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705211737472"}]},"ts":"1705211737472"} 2024-01-14 05:55:37,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. 2024-01-14 05:55:37,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. 2024-01-14 05:55:37,474 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=91ffecf3af843307d3744fa2072e9776, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:55:37,475 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705211737474"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705211737474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705211737474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705211737474"}]},"ts":"1705211737474"} 2024-01-14 05:55:37,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2024-01-14 05:55:37,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure d45c4e1d53988929334afb608fa224c4, server=jenkins-hbase4.apache.org,35407,1705211730266 in 191 msec 2024-01-14 05:55:37,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=23 2024-01-14 05:55:37,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=23, state=SUCCESS; OpenRegionProcedure 91ffecf3af843307d3744fa2072e9776, server=jenkins-hbase4.apache.org,38377,1705211730222 in 191 msec 2024-01-14 05:55:37,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=d45c4e1d53988929334afb608fa224c4, ASSIGN in 352 msec 2024-01-14 05:55:37,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=23, resume processing ppid=22 2024-01-14 05:55:37,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=91ffecf3af843307d3744fa2072e9776, ASSIGN in 354 msec 2024-01-14 05:55:37,485 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-14 05:55:37,485 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211737485"}]},"ts":"1705211737485"} 2024-01-14 05:55:37,488 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-01-14 05:55:37,492 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-01-14 05:55:37,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 438 msec 2024-01-14 05:55:37,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-14 05:55:37,813 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-01-14 05:55:37,814 DEBUG [Listener at localhost/35313] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-01-14 05:55:37,814 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:37,818 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-01-14 05:55:37,819 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:37,819 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-01-14 05:55:37,819 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:37,879 INFO [Listener at localhost/35313] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=308, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=170, AvailableMemoryMB=12439 2024-01-14 05:55:38,188 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:38,189 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:55:38,189 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705215337936 bypass), TestNs=QuotaState(ts=1705215337936 bypass)} 2024-01-14 05:55:38,189 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705215337936 bypass), TestQuotaAdmin2=QuotaState(ts=1705215337936 bypass)} 2024-01-14 05:55:38,189 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705215337936 [ TestNs:TestTable ])} 2024-01-14 05:55:38,189 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705215337936 bypass)} 2024-01-14 05:55:38,439 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:38,439 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:55:38,439 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705215337936 bypass), TestNs=QuotaState(ts=1705215337936 bypass)} 2024-01-14 05:55:38,440 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705215337936 bypass), TestNs:TestTable=QuotaState(ts=1705215337936 bypass), TestQuotaAdmin1=QuotaState(ts=1705215337936 bypass)} 2024-01-14 05:55:38,440 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705215337936 [ TestNs:TestTable ])} 2024-01-14 05:55:38,440 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705215337936 bypass)} 2024-01-14 05:55:38,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:38,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42954 deadline: 1705211748456, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:38,534 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-01-14 05:55:38,583 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-01-14 05:55:38,584 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-01-14 05:55:38,584 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-01-14 05:55:38,585 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-01-14 05:55:38,585 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-01-14 05:55:38,586 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-01-14 05:55:38,586 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-01-14 05:55:38,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:38,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42954 deadline: 1705211748455, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:39,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:39,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42954 deadline: 1705211748455, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:39,238 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-01-14 05:55:39,238 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-01-14 05:55:39,239 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-01-14 05:55:39,239 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-01-14 05:55:39,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:39,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42954 deadline: 1705211748456, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:41,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:41,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42954 deadline: 1705211748456, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:43,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:43,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42954 deadline: 1705211748456, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:43,749 ERROR [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10330: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4., hostname=jenkins-hbase4.apache.org,35407,1705211730266, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 05:55:43,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:43,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:42954 deadline: 1705211753752, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:44,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:44,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:42954 deadline: 1705211753752, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:44,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:44,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:42954 deadline: 1705211753752, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:45,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:45,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:42954 deadline: 1705211753752, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:46,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:46,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:42954 deadline: 1705211753752, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:49,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:49,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:42954 deadline: 1705211753751, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:55:49,071 ERROR [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10338: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4., hostname=jenkins-hbase4.apache.org,35407,1705211730266, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 05:55:49,332 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:49,332 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:55:49,332 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705218937936 bypass), TestNs=QuotaState(ts=1705218937936 bypass)} 2024-01-14 05:55:49,332 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705218937936 bypass), TestQuotaAdmin2=QuotaState(ts=1705218937936 bypass)} 2024-01-14 05:55:49,332 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705218937936 bypass)} 2024-01-14 05:55:49,332 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705218937936 bypass)} 2024-01-14 05:55:49,582 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:49,583 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:55:49,583 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705218937936 bypass), TestNs=QuotaState(ts=1705218937936 bypass)} 2024-01-14 05:55:49,583 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705218937936 bypass), TestNs:TestTable=QuotaState(ts=1705218937936 bypass), TestQuotaAdmin1=QuotaState(ts=1705218937936 bypass)} 2024-01-14 05:55:49,583 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705218937936 bypass)} 2024-01-14 05:55:49,583 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705218937936 bypass)} 2024-01-14 05:55:49,602 INFO [Listener at localhost/35313] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=291 (was 308), OpenFileDescriptor=599 (was 632), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=180 (was 202), ProcessCount=170 (was 170), AvailableMemoryMB=13717 (was 12439) - AvailableMemoryMB LEAK? - 2024-01-14 05:55:49,617 INFO [Listener at localhost/35313] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=180, ProcessCount=170, AvailableMemoryMB=13716 2024-01-14 05:55:49,883 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:49,883 INFO [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-14 05:55:50,134 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:55:50,135 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705222538036 bypass), TestNs=QuotaState(ts=1705222538036 bypass)} 2024-01-14 05:55:50,136 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705222538036 bypass), TestQuotaAdmin2=QuotaState(ts=1705222538036 bypass)} 2024-01-14 05:55:50,136 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705222538036 [ default ])} 2024-01-14 05:55:50,136 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705222538036 bypass)} 2024-01-14 05:55:50,387 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:55:50,387 INFO [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-14 05:55:50,637 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:55:50,638 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705222538136 bypass), TestNs=QuotaState(ts=1705222538136 bypass)} 2024-01-14 05:55:50,640 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705222538136 bypass), TestNs:TestTable=QuotaState(ts=1705222538136 bypass), TestQuotaAdmin1=QuotaState(ts=1705222538136 bypass)} 2024-01-14 05:55:50,640 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705222538136 [ default ])} 2024-01-14 05:55:50,641 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705222538136 bypass)} 2024-01-14 05:55:50,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 05:55:50,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:42954 deadline: 1705211760651, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 05:55:50,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 05:55:50,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:42954 deadline: 1705211760651, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 05:55:51,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 05:55:51,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:42954 deadline: 1705211760651, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 05:55:52,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 05:55:52,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211760652, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 05:55:53,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 05:55:53,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211760651, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 05:55:55,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 05:55:55,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211760651, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 05:55:55,949 ERROR [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10314: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c., hostname=jenkins-hbase4.apache.org,35407,1705211730266, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 05:55:55,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:55:55,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211765964, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:55:56,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:55:56,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211765963, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:55:56,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:55:56,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211765964, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:55:57,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:55:57,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211765964, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:55:58,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:55:58,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211765964, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:01,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:01,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211765964, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:01,254 ERROR [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10305: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c., hostname=jenkins-hbase4.apache.org,35407,1705211730266, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 05:56:01,511 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:01,511 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:01,511 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705226138136 bypass), TestNs=QuotaState(ts=1705226138136 bypass)} 2024-01-14 05:56:01,511 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705226138136 bypass), TestQuotaAdmin2=QuotaState(ts=1705226138136 bypass)} 2024-01-14 05:56:01,511 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705226138136 bypass)} 2024-01-14 05:56:01,511 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705226138136 bypass)} 2024-01-14 05:56:01,761 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:01,761 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:01,762 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705226138136 bypass), TestNs=QuotaState(ts=1705226138136 bypass)} 2024-01-14 05:56:01,762 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705226138136 bypass), TestNs:TestTable=QuotaState(ts=1705226138136 bypass), TestQuotaAdmin1=QuotaState(ts=1705226138136 bypass)} 2024-01-14 05:56:01,762 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705226138136 bypass)} 2024-01-14 05:56:01,762 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705226138136 bypass)} 2024-01-14 05:56:01,773 INFO [Listener at localhost/35313] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291 (was 291), OpenFileDescriptor=595 (was 599), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=147 (was 180), ProcessCount=168 (was 170), AvailableMemoryMB=14391 (was 13716) - AvailableMemoryMB LEAK? - 2024-01-14 05:56:01,785 INFO [Listener at localhost/35313] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=291, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=147, ProcessCount=168, AvailableMemoryMB=14391 2024-01-14 05:56:02,048 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:02,048 INFO [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-14 05:56:02,299 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:02,300 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705229738236 bypass), TestNs=QuotaState(ts=1705229738236 bypass)} 2024-01-14 05:56:02,301 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705229738236 bypass), TestQuotaAdmin2=QuotaState(ts=1705229738236 bypass)} 2024-01-14 05:56:02,301 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705229738236 global-limiter)} 2024-01-14 05:56:02,301 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705229738236 bypass)} 2024-01-14 05:56:02,551 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:02,551 INFO [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-14 05:56:02,802 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:02,802 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705229738336 bypass), TestNs=QuotaState(ts=1705229738336 bypass)} 2024-01-14 05:56:02,803 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705229738336 bypass), TestNs:TestTable=QuotaState(ts=1705229738336 bypass), TestQuotaAdmin1=QuotaState(ts=1705229738336 bypass)} 2024-01-14 05:56:02,803 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705229738336 global-limiter)} 2024-01-14 05:56:02,803 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705229738336 bypass)} 2024-01-14 05:56:02,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:02,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211772818, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:03,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:03,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211772817, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:03,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:03,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211772818, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:04,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:04,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211772818, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:05,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:05,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211772818, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:08,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:08,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211772818, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:08,125 ERROR [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10318: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c., hostname=jenkins-hbase4.apache.org,35407,1705211730266, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 05:56:08,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 05:56:08,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211778131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 05:56:08,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 05:56:08,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211778131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 05:56:08,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 05:56:08,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211778131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 05:56:09,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 05:56:09,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211778131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 05:56:10,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 05:56:10,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211778132, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 05:56:13,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 05:56:13,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211778131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 05:56:13,427 ERROR [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10339: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c., hostname=jenkins-hbase4.apache.org,35407,1705211730266, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 05:56:13,683 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:13,684 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:13,684 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705233338336 bypass), TestNs=QuotaState(ts=1705233338336 bypass)} 2024-01-14 05:56:13,684 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705233338336 bypass), TestQuotaAdmin2=QuotaState(ts=1705233338336 bypass)} 2024-01-14 05:56:13,684 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705233338336 bypass)} 2024-01-14 05:56:13,684 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705233338336 bypass)} 2024-01-14 05:56:13,934 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:13,934 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:13,934 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705233338336 bypass), TestNs=QuotaState(ts=1705233338336 bypass)} 2024-01-14 05:56:13,934 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705233338336 bypass), TestNs:TestTable=QuotaState(ts=1705233338336 bypass), TestQuotaAdmin1=QuotaState(ts=1705233338336 bypass)} 2024-01-14 05:56:13,935 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705233338336 bypass)} 2024-01-14 05:56:13,935 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705233338336 bypass)} 2024-01-14 05:56:13,946 INFO [Listener at localhost/35313] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=282 (was 291), OpenFileDescriptor=593 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=124 (was 147), ProcessCount=168 (was 168), AvailableMemoryMB=14388 (was 14391) 2024-01-14 05:56:13,959 INFO [Listener at localhost/35313] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=124, ProcessCount=168, AvailableMemoryMB=14387 2024-01-14 05:56:14,217 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:14,218 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:14,219 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705236938336 bypass), TestNs=QuotaState(ts=1705236938336 bypass)} 2024-01-14 05:56:14,220 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705236938336 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1705236938336 bypass)} 2024-01-14 05:56:14,220 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-14 05:56:14,220 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705236938336 bypass)} 2024-01-14 05:56:14,471 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:14,472 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:14,472 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705236938336 bypass), TestNs=QuotaState(ts=1705236938336 bypass)} 2024-01-14 05:56:14,473 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705236938336 bypass), TestNs:TestTable=QuotaState(ts=1705236938336 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1705236938336 bypass)} 2024-01-14 05:56:14,473 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-14 05:56:14,473 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705236938336 bypass)} 2024-01-14 05:56:14,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:14,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:42954 deadline: 1705211784487, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:14,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:14,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:42954 deadline: 1705211784488, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:15,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:15,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:42954 deadline: 1705211784487, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:16,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:16,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:42954 deadline: 1705211784488, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:17,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:17,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:42954 deadline: 1705211784488, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:19,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:19,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:42954 deadline: 1705211784488, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:19,792 ERROR [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10337: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4., hostname=jenkins-hbase4.apache.org,35407,1705211730266, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 05:56:19,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:19,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42954 deadline: 1705211789794, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:20,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:20,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42954 deadline: 1705211789793, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:20,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:20,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42954 deadline: 1705211789794, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:21,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:21,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42954 deadline: 1705211789793, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:22,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:22,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42954 deadline: 1705211789793, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:25,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:25,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42954 deadline: 1705211789794, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 05:56:25,093 ERROR [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10343: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4., hostname=jenkins-hbase4.apache.org,35407,1705211730266, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 05:56:25,350 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:25,350 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:25,350 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705240538336 bypass), TestNs=QuotaState(ts=1705240538336 bypass)} 2024-01-14 05:56:25,350 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705240538336 bypass), TestQuotaAdmin2=QuotaState(ts=1705240538336 bypass)} 2024-01-14 05:56:25,350 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-14 05:56:25,350 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705240538336 bypass)} 2024-01-14 05:56:25,601 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:25,601 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:25,601 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705240538336 bypass), TestNs=QuotaState(ts=1705240538336 bypass)} 2024-01-14 05:56:25,601 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705240538336 bypass), TestNs:TestTable=QuotaState(ts=1705240538336 bypass), TestQuotaAdmin1=QuotaState(ts=1705240538336 bypass)} 2024-01-14 05:56:25,601 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705240538336 bypass)} 2024-01-14 05:56:25,601 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705240538336 bypass)} 2024-01-14 05:56:25,613 INFO [Listener at localhost/35313] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281 (was 282), OpenFileDescriptor=593 (was 593), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=105 (was 124), ProcessCount=168 (was 168), AvailableMemoryMB=14388 (was 14387) - AvailableMemoryMB LEAK? - 2024-01-14 05:56:25,624 INFO [Listener at localhost/35313] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=281, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=105, ProcessCount=168, AvailableMemoryMB=14388 2024-01-14 05:56:25,885 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:25,886 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:25,886 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705244138336 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1705244138336 bypass)} 2024-01-14 05:56:25,887 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705244138336 bypass), TestQuotaAdmin2=QuotaState(ts=1705244138336 bypass)} 2024-01-14 05:56:25,887 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-14 05:56:25,887 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705244138336 bypass)} 2024-01-14 05:56:26,137 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:26,137 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:26,138 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705244138336 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1705244138336 bypass)} 2024-01-14 05:56:26,138 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705244138336 bypass), TestNs:TestTable=QuotaState(ts=1705244138336 bypass), TestQuotaAdmin1=QuotaState(ts=1705244138336 bypass)} 2024-01-14 05:56:26,138 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-14 05:56:26,138 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705244138336 bypass)} 2024-01-14 05:56:26,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 05:56:26,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211796154, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 05:56:26,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 05:56:26,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211796153, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 05:56:26,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 05:56:26,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211796154, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 05:56:27,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 05:56:27,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211796153, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 05:56:28,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 05:56:28,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211796154, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 05:56:31,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 05:56:31,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42954 deadline: 1705211796154, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 05:56:31,450 ERROR [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10325: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c., hostname=jenkins-hbase4.apache.org,35407,1705211730266, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 05:56:31,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:31,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211801459, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:31,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:31,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211801460, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:32,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:32,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211801460, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:32,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:32,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211801460, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:34,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:34,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211801460, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:36,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:36,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42954 deadline: 1705211801460, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 05:56:36,759 ERROR [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10308: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c., hostname=jenkins-hbase4.apache.org,35407,1705211730266, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 05:56:37,016 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:37,017 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:37,017 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705247738336 bypass), TestNs=QuotaState(ts=1705247738336 bypass)} 2024-01-14 05:56:37,017 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705247738336 bypass), TestQuotaAdmin2=QuotaState(ts=1705247738336 bypass)} 2024-01-14 05:56:37,017 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-14 05:56:37,017 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705247738336 bypass)} 2024-01-14 05:56:37,267 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 05:56:37,267 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 05:56:37,267 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705247738336 bypass), TestNs=QuotaState(ts=1705247738336 bypass)} 2024-01-14 05:56:37,267 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705247738336 bypass), TestNs:TestTable=QuotaState(ts=1705247738336 bypass), TestQuotaAdmin1=QuotaState(ts=1705247738336 bypass)} 2024-01-14 05:56:37,267 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705247738336 bypass)} 2024-01-14 05:56:37,267 DEBUG [Listener at localhost/35313] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705247738336 bypass)} 2024-01-14 05:56:37,279 INFO [Listener at localhost/35313] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=266 (was 281), OpenFileDescriptor=584 (was 593), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=95 (was 105), ProcessCount=168 (was 168), AvailableMemoryMB=14387 (was 14388) 2024-01-14 05:56:37,282 INFO [Listener at localhost/35313] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-01-14 05:56:37,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-01-14 05:56:37,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-01-14 05:56:37,297 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211797297"}]},"ts":"1705211797297"} 2024-01-14 05:56:37,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-14 05:56:37,299 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-01-14 05:56:37,301 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-01-14 05:56:37,303 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=e4945af9a1f5d597b58c8c0bd75f106c, UNASSIGN}] 2024-01-14 05:56:37,304 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=e4945af9a1f5d597b58c8c0bd75f106c, UNASSIGN 2024-01-14 05:56:37,305 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e4945af9a1f5d597b58c8c0bd75f106c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:56:37,305 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211797305"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705211797305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705211797305"}]},"ts":"1705211797305"} 2024-01-14 05:56:37,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure e4945af9a1f5d597b58c8c0bd75f106c, server=jenkins-hbase4.apache.org,35407,1705211730266}] 2024-01-14 05:56:37,440 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,35407,1705211730266, timeout=1705211797462, delay=22, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure e4945af9a1f5d597b58c8c0bd75f106c, server=jenkins-hbase4.apache.org,35407,1705211730266]] 2024-01-14 05:56:37,464 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:56:37,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:56:37,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4945af9a1f5d597b58c8c0bd75f106c, disabling compactions & flushes 2024-01-14 05:56:37,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. 2024-01-14 05:56:37,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. 2024-01-14 05:56:37,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. after waiting 0 ms 2024-01-14 05:56:37,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. 2024-01-14 05:56:37,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e4945af9a1f5d597b58c8c0bd75f106c 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-01-14 05:56:37,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/.tmp/cf/af7dd29b4c404cd8b66f6c74e3d987ec 2024-01-14 05:56:37,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-14 05:56:37,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/.tmp/cf/af7dd29b4c404cd8b66f6c74e3d987ec as hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/cf/af7dd29b4c404cd8b66f6c74e3d987ec 2024-01-14 05:56:37,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/cf/af7dd29b4c404cd8b66f6c74e3d987ec, entries=6, sequenceid=21, filesize=4.7 K 2024-01-14 05:56:37,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for e4945af9a1f5d597b58c8c0bd75f106c in 138ms, sequenceid=21, compaction requested=false 2024-01-14 05:56:37,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-01-14 05:56:37,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c. 2024-01-14 05:56:37,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4945af9a1f5d597b58c8c0bd75f106c: 2024-01-14 05:56:37,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:56:37,618 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e4945af9a1f5d597b58c8c0bd75f106c, regionState=CLOSED 2024-01-14 05:56:37,618 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211797618"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705211797618"}]},"ts":"1705211797618"} 2024-01-14 05:56:37,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-01-14 05:56:37,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure e4945af9a1f5d597b58c8c0bd75f106c, server=jenkins-hbase4.apache.org,35407,1705211730266 in 313 msec 2024-01-14 05:56:37,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-01-14 05:56:37,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=e4945af9a1f5d597b58c8c0bd75f106c, UNASSIGN in 319 msec 2024-01-14 05:56:37,625 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211797625"}]},"ts":"1705211797625"} 2024-01-14 05:56:37,626 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-01-14 05:56:37,628 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-01-14 05:56:37,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 340 msec 2024-01-14 05:56:38,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-14 05:56:38,051 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-01-14 05:56:38,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-01-14 05:56:38,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-14 05:56:38,064 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-14 05:56:38,066 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-14 05:56:38,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-01-14 05:56:38,072 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:56:38,076 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/cf, FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/recovered.edits] 2024-01-14 05:56:38,086 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/cf/af7dd29b4c404cd8b66f6c74e3d987ec to hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/archive/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/cf/af7dd29b4c404cd8b66f6c74e3d987ec 2024-01-14 05:56:38,091 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/recovered.edits/24.seqid to hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/archive/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c/recovered.edits/24.seqid 2024-01-14 05:56:38,092 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin0/e4945af9a1f5d597b58c8c0bd75f106c 2024-01-14 05:56:38,092 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-01-14 05:56:38,096 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-14 05:56:38,116 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-01-14 05:56:38,118 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-01-14 05:56:38,120 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-14 05:56:38,120 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-01-14 05:56:38,120 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705211798120"}]},"ts":"9223372036854775807"} 2024-01-14 05:56:38,122 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-14 05:56:38,122 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e4945af9a1f5d597b58c8c0bd75f106c, NAME => 'TestQuotaAdmin0,,1705211734428.e4945af9a1f5d597b58c8c0bd75f106c.', STARTKEY => '', ENDKEY => ''}] 2024-01-14 05:56:38,122 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-01-14 05:56:38,122 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1705211798122"}]},"ts":"9223372036854775807"} 2024-01-14 05:56:38,124 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-01-14 05:56:38,127 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-14 05:56:38,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 70 msec 2024-01-14 05:56:38,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-01-14 05:56:38,321 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-01-14 05:56:38,322 INFO [Listener at localhost/35313] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-01-14 05:56:38,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-01-14 05:56:38,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-01-14 05:56:38,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-01-14 05:56:38,327 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211798327"}]},"ts":"1705211798327"} 2024-01-14 05:56:38,329 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-01-14 05:56:38,331 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-01-14 05:56:38,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=1a2803835415b06960721578e6ae3498, UNASSIGN}] 2024-01-14 05:56:38,332 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=1a2803835415b06960721578e6ae3498, UNASSIGN 2024-01-14 05:56:38,333 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=1a2803835415b06960721578e6ae3498, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:56:38,334 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211798333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705211798333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705211798333"}]},"ts":"1705211798333"} 2024-01-14 05:56:38,335 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 1a2803835415b06960721578e6ae3498, server=jenkins-hbase4.apache.org,35407,1705211730266}] 2024-01-14 05:56:38,487 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:56:38,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1a2803835415b06960721578e6ae3498 2024-01-14 05:56:38,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1a2803835415b06960721578e6ae3498, disabling compactions & flushes 2024-01-14 05:56:38,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. 2024-01-14 05:56:38,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. 2024-01-14 05:56:38,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. after waiting 0 ms 2024-01-14 05:56:38,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. 2024-01-14 05:56:38,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-14 05:56:38,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498. 2024-01-14 05:56:38,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1a2803835415b06960721578e6ae3498: 2024-01-14 05:56:38,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1a2803835415b06960721578e6ae3498 2024-01-14 05:56:38,497 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=1a2803835415b06960721578e6ae3498, regionState=CLOSED 2024-01-14 05:56:38,497 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211798497"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705211798497"}]},"ts":"1705211798497"} 2024-01-14 05:56:38,501 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-01-14 05:56:38,501 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 1a2803835415b06960721578e6ae3498, server=jenkins-hbase4.apache.org,35407,1705211730266 in 164 msec 2024-01-14 05:56:38,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-01-14 05:56:38,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=1a2803835415b06960721578e6ae3498, UNASSIGN in 170 msec 2024-01-14 05:56:38,504 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211798504"}]},"ts":"1705211798504"} 2024-01-14 05:56:38,505 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-01-14 05:56:38,507 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-01-14 05:56:38,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 186 msec 2024-01-14 05:56:38,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-01-14 05:56:38,578 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-01-14 05:56:38,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-01-14 05:56:38,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-14 05:56:38,582 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-14 05:56:38,583 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-14 05:56:38,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-01-14 05:56:38,587 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498 2024-01-14 05:56:38,589 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498/cf, FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498/recovered.edits] 2024-01-14 05:56:38,597 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498/recovered.edits/4.seqid to hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/archive/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498/recovered.edits/4.seqid 2024-01-14 05:56:38,598 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin1/1a2803835415b06960721578e6ae3498 2024-01-14 05:56:38,598 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-01-14 05:56:38,601 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-14 05:56:38,603 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-01-14 05:56:38,605 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-01-14 05:56:38,607 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-14 05:56:38,607 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-01-14 05:56:38,607 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705211798607"}]},"ts":"9223372036854775807"} 2024-01-14 05:56:38,608 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-14 05:56:38,608 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1a2803835415b06960721578e6ae3498, NAME => 'TestQuotaAdmin1,,1705211735232.1a2803835415b06960721578e6ae3498.', STARTKEY => '', ENDKEY => ''}] 2024-01-14 05:56:38,608 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-01-14 05:56:38,608 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1705211798608"}]},"ts":"9223372036854775807"} 2024-01-14 05:56:38,610 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-01-14 05:56:38,612 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-14 05:56:38,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 33 msec 2024-01-14 05:56:38,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-01-14 05:56:38,836 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-01-14 05:56:38,837 INFO [Listener at localhost/35313] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-01-14 05:56:38,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-01-14 05:56:38,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-01-14 05:56:38,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-01-14 05:56:38,842 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211798842"}]},"ts":"1705211798842"} 2024-01-14 05:56:38,844 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-01-14 05:56:38,848 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-01-14 05:56:38,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0a86fbc5c7674f2fd4e51feea61e8385, UNASSIGN}] 2024-01-14 05:56:38,850 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0a86fbc5c7674f2fd4e51feea61e8385, UNASSIGN 2024-01-14 05:56:38,851 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=0a86fbc5c7674f2fd4e51feea61e8385, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:56:38,851 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211798851"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705211798851"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705211798851"}]},"ts":"1705211798851"} 2024-01-14 05:56:38,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 0a86fbc5c7674f2fd4e51feea61e8385, server=jenkins-hbase4.apache.org,38377,1705211730222}] 2024-01-14 05:56:39,005 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:56:39,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:56:39,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a86fbc5c7674f2fd4e51feea61e8385, disabling compactions & flushes 2024-01-14 05:56:39,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. 2024-01-14 05:56:39,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. 2024-01-14 05:56:39,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. after waiting 0 ms 2024-01-14 05:56:39,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. 2024-01-14 05:56:39,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-14 05:56:39,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385. 2024-01-14 05:56:39,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a86fbc5c7674f2fd4e51feea61e8385: 2024-01-14 05:56:39,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:56:39,017 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=0a86fbc5c7674f2fd4e51feea61e8385, regionState=CLOSED 2024-01-14 05:56:39,017 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705211799017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705211799017"}]},"ts":"1705211799017"} 2024-01-14 05:56:39,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-01-14 05:56:39,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 0a86fbc5c7674f2fd4e51feea61e8385, server=jenkins-hbase4.apache.org,38377,1705211730222 in 166 msec 2024-01-14 05:56:39,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-01-14 05:56:39,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0a86fbc5c7674f2fd4e51feea61e8385, UNASSIGN in 172 msec 2024-01-14 05:56:39,024 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211799024"}]},"ts":"1705211799024"} 2024-01-14 05:56:39,025 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-01-14 05:56:39,027 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-01-14 05:56:39,029 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 191 msec 2024-01-14 05:56:39,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-01-14 05:56:39,093 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-01-14 05:56:39,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-01-14 05:56:39,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-14 05:56:39,097 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-14 05:56:39,098 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-14 05:56:39,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-01-14 05:56:39,102 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:56:39,105 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385/cf, FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385/recovered.edits] 2024-01-14 05:56:39,112 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385/recovered.edits/4.seqid to hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/archive/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385/recovered.edits/4.seqid 2024-01-14 05:56:39,112 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/default/TestQuotaAdmin2/0a86fbc5c7674f2fd4e51feea61e8385 2024-01-14 05:56:39,112 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-01-14 05:56:39,116 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-14 05:56:39,117 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-01-14 05:56:39,119 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-01-14 05:56:39,120 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-14 05:56:39,121 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-01-14 05:56:39,121 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705211799121"}]},"ts":"9223372036854775807"} 2024-01-14 05:56:39,122 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-14 05:56:39,122 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0a86fbc5c7674f2fd4e51feea61e8385, NAME => 'TestQuotaAdmin2,,1705211736008.0a86fbc5c7674f2fd4e51feea61e8385.', STARTKEY => '', ENDKEY => ''}] 2024-01-14 05:56:39,122 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-01-14 05:56:39,122 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1705211799122"}]},"ts":"9223372036854775807"} 2024-01-14 05:56:39,124 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-01-14 05:56:39,126 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-14 05:56:39,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 32 msec 2024-01-14 05:56:39,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-01-14 05:56:39,352 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-01-14 05:56:39,352 INFO [Listener at localhost/35313] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-01-14 05:56:39,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-01-14 05:56:39,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-01-14 05:56:39,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-01-14 05:56:39,357 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211799357"}]},"ts":"1705211799357"} 2024-01-14 05:56:39,359 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-01-14 05:56:39,361 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-01-14 05:56:39,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=91ffecf3af843307d3744fa2072e9776, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=d45c4e1d53988929334afb608fa224c4, UNASSIGN}] 2024-01-14 05:56:39,362 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=d45c4e1d53988929334afb608fa224c4, UNASSIGN 2024-01-14 05:56:39,362 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=91ffecf3af843307d3744fa2072e9776, UNASSIGN 2024-01-14 05:56:39,363 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=d45c4e1d53988929334afb608fa224c4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:56:39,363 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=91ffecf3af843307d3744fa2072e9776, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:56:39,363 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705211799363"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705211799363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705211799363"}]},"ts":"1705211799363"} 2024-01-14 05:56:39,363 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705211799363"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705211799363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705211799363"}]},"ts":"1705211799363"} 2024-01-14 05:56:39,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=41, state=RUNNABLE; CloseRegionProcedure d45c4e1d53988929334afb608fa224c4, server=jenkins-hbase4.apache.org,35407,1705211730266}] 2024-01-14 05:56:39,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=40, state=RUNNABLE; CloseRegionProcedure 91ffecf3af843307d3744fa2072e9776, server=jenkins-hbase4.apache.org,38377,1705211730222}] 2024-01-14 05:56:39,517 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:56:39,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d45c4e1d53988929334afb608fa224c4 2024-01-14 05:56:39,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d45c4e1d53988929334afb608fa224c4, disabling compactions & flushes 2024-01-14 05:56:39,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. 2024-01-14 05:56:39,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. 2024-01-14 05:56:39,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. after waiting 0 ms 2024-01-14 05:56:39,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. 2024-01-14 05:56:39,519 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:56:39,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 91ffecf3af843307d3744fa2072e9776 2024-01-14 05:56:39,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 91ffecf3af843307d3744fa2072e9776, disabling compactions & flushes 2024-01-14 05:56:39,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. 2024-01-14 05:56:39,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. 2024-01-14 05:56:39,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. after waiting 0 ms 2024-01-14 05:56:39,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. 2024-01-14 05:56:39,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-14 05:56:39,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-14 05:56:39,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4. 2024-01-14 05:56:39,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d45c4e1d53988929334afb608fa224c4: 2024-01-14 05:56:39,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776. 2024-01-14 05:56:39,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 91ffecf3af843307d3744fa2072e9776: 2024-01-14 05:56:39,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d45c4e1d53988929334afb608fa224c4 2024-01-14 05:56:39,529 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=d45c4e1d53988929334afb608fa224c4, regionState=CLOSED 2024-01-14 05:56:39,530 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705211799529"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705211799529"}]},"ts":"1705211799529"} 2024-01-14 05:56:39,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 91ffecf3af843307d3744fa2072e9776 2024-01-14 05:56:39,530 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=91ffecf3af843307d3744fa2072e9776, regionState=CLOSED 2024-01-14 05:56:39,530 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705211799530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705211799530"}]},"ts":"1705211799530"} 2024-01-14 05:56:39,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=41 2024-01-14 05:56:39,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=41, state=SUCCESS; CloseRegionProcedure d45c4e1d53988929334afb608fa224c4, server=jenkins-hbase4.apache.org,35407,1705211730266 in 166 msec 2024-01-14 05:56:39,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=40 2024-01-14 05:56:39,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=40, state=SUCCESS; CloseRegionProcedure 91ffecf3af843307d3744fa2072e9776, server=jenkins-hbase4.apache.org,38377,1705211730222 in 166 msec 2024-01-14 05:56:39,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=d45c4e1d53988929334afb608fa224c4, UNASSIGN in 172 msec 2024-01-14 05:56:39,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2024-01-14 05:56:39,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=91ffecf3af843307d3744fa2072e9776, UNASSIGN in 173 msec 2024-01-14 05:56:39,537 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705211799537"}]},"ts":"1705211799537"} 2024-01-14 05:56:39,538 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-01-14 05:56:39,541 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-01-14 05:56:39,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 189 msec 2024-01-14 05:56:39,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-01-14 05:56:39,608 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-01-14 05:56:39,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-01-14 05:56:39,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-01-14 05:56:39,612 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-14 05:56:39,613 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-14 05:56:39,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-01-14 05:56:39,619 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776 2024-01-14 05:56:39,619 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4 2024-01-14 05:56:39,622 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776/cf, FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776/recovered.edits] 2024-01-14 05:56:39,622 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4/cf, FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4/recovered.edits] 2024-01-14 05:56:39,629 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776/recovered.edits/4.seqid to hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/archive/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776/recovered.edits/4.seqid 2024-01-14 05:56:39,629 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4/recovered.edits/4.seqid to hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/archive/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4/recovered.edits/4.seqid 2024-01-14 05:56:39,629 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/91ffecf3af843307d3744fa2072e9776 2024-01-14 05:56:39,630 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/.tmp/data/TestNs/TestTable/d45c4e1d53988929334afb608fa224c4 2024-01-14 05:56:39,630 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-01-14 05:56:39,633 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-14 05:56:39,634 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-01-14 05:56:39,636 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-01-14 05:56:39,637 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-14 05:56:39,637 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-01-14 05:56:39,638 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705211799637"}]},"ts":"9223372036854775807"} 2024-01-14 05:56:39,638 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705211799637"}]},"ts":"9223372036854775807"} 2024-01-14 05:56:39,639 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-01-14 05:56:39,639 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 91ffecf3af843307d3744fa2072e9776, NAME => 'TestNs:TestTable,,1705211737053.91ffecf3af843307d3744fa2072e9776.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d45c4e1d53988929334afb608fa224c4, NAME => 'TestNs:TestTable,1,1705211737053.d45c4e1d53988929334afb608fa224c4.', STARTKEY => '1', ENDKEY => ''}] 2024-01-14 05:56:39,639 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-01-14 05:56:39,639 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1705211799639"}]},"ts":"9223372036854775807"} 2024-01-14 05:56:39,641 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-01-14 05:56:39,643 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-14 05:56:39,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 34 msec 2024-01-14 05:56:39,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-01-14 05:56:39,866 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-01-14 05:56:39,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-01-14 05:56:39,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-01-14 05:56:39,879 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-14 05:56:39,881 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-14 05:56:39,883 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-14 05:56:39,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-01-14 05:56:39,884 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-01-14 05:56:39,884 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-14 05:56:39,885 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-14 05:56:39,887 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-14 05:56:39,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 16 msec 2024-01-14 05:56:40,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-01-14 05:56:40,135 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-01-14 05:56:40,135 INFO [Listener at localhost/35313] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-14 05:56:40,135 DEBUG [Listener at localhost/35313] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08b1db53 to 127.0.0.1:52071 2024-01-14 05:56:40,135 DEBUG [Listener at localhost/35313] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 05:56:40,136 DEBUG [Listener at localhost/35313] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-01-14 05:56:40,136 DEBUG [Listener at localhost/35313] util.JVMClusterUtil(257): Found active master hash=969310897, stopped=false 2024-01-14 05:56:40,136 DEBUG [Listener at localhost/35313] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-01-14 05:56:40,137 INFO [Listener at localhost/35313] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44089,1705211729063 2024-01-14 05:56:40,139 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-14 05:56:40,139 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-14 05:56:40,139 INFO [Listener at localhost/35313] procedure2.ProcedureExecutor(675): Stopping 2024-01-14 05:56:40,139 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 05:56:40,139 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-14 05:56:40,140 DEBUG [Listener at localhost/35313] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2604a8df to 127.0.0.1:52071 2024-01-14 05:56:40,140 DEBUG [Listener at localhost/35313] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 05:56:40,140 INFO [Listener at localhost/35313] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,38377,1705211730222' ***** 2024-01-14 05:56:40,140 INFO [Listener at localhost/35313] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2024-01-14 05:56:40,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-14 05:56:40,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-14 05:56:40,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-14 05:56:40,140 INFO [Listener at localhost/35313] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,35407,1705211730266' ***** 2024-01-14 05:56:40,141 INFO [Listener at localhost/35313] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2024-01-14 05:56:40,141 INFO [RS:0;jenkins-hbase4:38377] regionserver.HeapMemoryManager(220): Stopping 2024-01-14 05:56:40,141 INFO [RS:1;jenkins-hbase4:35407] regionserver.HeapMemoryManager(220): Stopping 2024-01-14 05:56:40,141 INFO [RS:0;jenkins-hbase4:38377] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-01-14 05:56:40,141 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-01-14 05:56:40,141 INFO [RS:0;jenkins-hbase4:38377] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-01-14 05:56:40,141 INFO [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(3308): Received CLOSE for e77cee140062c8412e5f5133ddfffd6b 2024-01-14 05:56:40,141 INFO [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(3308): Received CLOSE for 429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:56:40,142 INFO [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:56:40,142 INFO [RS:0;jenkins-hbase4:38377] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-14 05:56:40,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e77cee140062c8412e5f5133ddfffd6b, disabling compactions & flushes 2024-01-14 05:56:40,141 INFO [RS:1;jenkins-hbase4:35407] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-01-14 05:56:40,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. 2024-01-14 05:56:40,142 DEBUG [RS:0;jenkins-hbase4:38377] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35f20ff3 to 127.0.0.1:52071 2024-01-14 05:56:40,142 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-01-14 05:56:40,142 DEBUG [RS:0;jenkins-hbase4:38377] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 05:56:40,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. 2024-01-14 05:56:40,142 INFO [RS:1;jenkins-hbase4:35407] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-01-14 05:56:40,143 INFO [RS:0;jenkins-hbase4:38377] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-01-14 05:56:40,143 INFO [RS:0;jenkins-hbase4:38377] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-01-14 05:56:40,143 INFO [RS:0;jenkins-hbase4:38377] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-01-14 05:56:40,143 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:56:40,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. after waiting 0 ms 2024-01-14 05:56:40,143 INFO [RS:1;jenkins-hbase4:35407] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-14 05:56:40,143 INFO [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(3308): Received CLOSE for 1588230740 2024-01-14 05:56:40,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. 2024-01-14 05:56:40,144 DEBUG [RS:1;jenkins-hbase4:35407] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71266041 to 127.0.0.1:52071 2024-01-14 05:56:40,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e77cee140062c8412e5f5133ddfffd6b 1/1 column families, dataSize=147 B heapSize=704 B 2024-01-14 05:56:40,144 DEBUG [RS:1;jenkins-hbase4:35407] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 05:56:40,144 INFO [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1477): Waiting on 3 regions to close 2024-01-14 05:56:40,144 DEBUG [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1481): Online Regions={1588230740=hbase:meta,,1.1588230740, e77cee140062c8412e5f5133ddfffd6b=hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b., 429487984ddaf9a6bdc704a947dc5279=hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279.} 2024-01-14 05:56:40,144 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,35407,1705211730266; all regions closed. 2024-01-14 05:56:40,144 DEBUG [RS:1;jenkins-hbase4:35407] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-01-14 05:56:40,145 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-01-14 05:56:40,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-01-14 05:56:40,145 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-01-14 05:56:40,145 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-01-14 05:56:40,145 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-01-14 05:56:40,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-01-14 05:56:40,146 DEBUG [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1507): Waiting on 1588230740, 429487984ddaf9a6bdc704a947dc5279, e77cee140062c8412e5f5133ddfffd6b 2024-01-14 05:56:40,156 DEBUG [RS:1;jenkins-hbase4:35407] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/oldWALs 2024-01-14 05:56:40,156 INFO [RS:1;jenkins-hbase4:35407] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35407%2C1705211730266:(num 1705211732769) 2024-01-14 05:56:40,157 DEBUG [RS:1;jenkins-hbase4:35407] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 05:56:40,157 INFO [RS:1;jenkins-hbase4:35407] regionserver.LeaseManager(133): Closed leases 2024-01-14 05:56:40,157 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-01-14 05:56:40,157 INFO [RS:1;jenkins-hbase4:35407] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-01-14 05:56:40,157 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-14 05:56:40,157 INFO [RS:1;jenkins-hbase4:35407] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-01-14 05:56:40,157 INFO [RS:1;jenkins-hbase4:35407] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-01-14 05:56:40,158 INFO [RS:1;jenkins-hbase4:35407] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35407 2024-01-14 05:56:40,166 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:56:40,167 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-14 05:56:40,167 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35407,1705211730266 2024-01-14 05:56:40,167 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-14 05:56:40,167 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-14 05:56:40,168 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35407,1705211730266] 2024-01-14 05:56:40,168 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35407,1705211730266; numProcessing=1 2024-01-14 05:56:40,170 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35407,1705211730266 already deleted, retry=false 2024-01-14 05:56:40,170 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,35407,1705211730266 expired; onlineServers=1 2024-01-14 05:56:40,172 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-01-14 05:56:40,172 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-01-14 05:56:40,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b/.tmp/info/c1219fdb76f447a6ae0824efe49a143e 2024-01-14 05:56:40,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/.tmp/info/c153f8afa587452893366ee7b7a775d9 2024-01-14 05:56:40,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c1219fdb76f447a6ae0824efe49a143e 2024-01-14 05:56:40,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c153f8afa587452893366ee7b7a775d9 2024-01-14 05:56:40,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b/.tmp/info/c1219fdb76f447a6ae0824efe49a143e as hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b/info/c1219fdb76f447a6ae0824efe49a143e 2024-01-14 05:56:40,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c1219fdb76f447a6ae0824efe49a143e 2024-01-14 05:56:40,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b/info/c1219fdb76f447a6ae0824efe49a143e, entries=3, sequenceid=8, filesize=5.0 K 2024-01-14 05:56:40,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for e77cee140062c8412e5f5133ddfffd6b in 63ms, sequenceid=8, compaction requested=false 2024-01-14 05:56:40,211 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/.tmp/rep_barrier/97bd9543ebbc4c4394116f7b3cd4072c 2024-01-14 05:56:40,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/namespace/e77cee140062c8412e5f5133ddfffd6b/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-01-14 05:56:40,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. 2024-01-14 05:56:40,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e77cee140062c8412e5f5133ddfffd6b: 2024-01-14 05:56:40,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1705211733162.e77cee140062c8412e5f5133ddfffd6b. 2024-01-14 05:56:40,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 429487984ddaf9a6bdc704a947dc5279, disabling compactions & flushes 2024-01-14 05:56:40,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. 2024-01-14 05:56:40,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. 2024-01-14 05:56:40,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. after waiting 0 ms 2024-01-14 05:56:40,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. 2024-01-14 05:56:40,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 429487984ddaf9a6bdc704a947dc5279 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-01-14 05:56:40,219 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97bd9543ebbc4c4394116f7b3cd4072c 2024-01-14 05:56:40,243 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/.tmp/table/3072a09ec480484392e513d162536d4a 2024-01-14 05:56:40,251 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3072a09ec480484392e513d162536d4a 2024-01-14 05:56:40,252 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/.tmp/info/c153f8afa587452893366ee7b7a775d9 as hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/info/c153f8afa587452893366ee7b7a775d9 2024-01-14 05:56:40,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c153f8afa587452893366ee7b7a775d9 2024-01-14 05:56:40,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/info/c153f8afa587452893366ee7b7a775d9, entries=30, sequenceid=66, filesize=8.0 K 2024-01-14 05:56:40,261 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/.tmp/rep_barrier/97bd9543ebbc4c4394116f7b3cd4072c as hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/rep_barrier/97bd9543ebbc4c4394116f7b3cd4072c 2024-01-14 05:56:40,268 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97bd9543ebbc4c4394116f7b3cd4072c 2024-01-14 05:56:40,269 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/rep_barrier/97bd9543ebbc4c4394116f7b3cd4072c, entries=5, sequenceid=66, filesize=5.3 K 2024-01-14 05:56:40,269 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-14 05:56:40,269 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,35407,1705211730266; zookeeper connection closed. 2024-01-14 05:56:40,269 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x1012499f55f0002, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-14 05:56:40,269 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5805eab4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5805eab4 2024-01-14 05:56:40,270 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/.tmp/table/3072a09ec480484392e513d162536d4a as hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/table/3072a09ec480484392e513d162536d4a 2024-01-14 05:56:40,277 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3072a09ec480484392e513d162536d4a 2024-01-14 05:56:40,277 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/table/3072a09ec480484392e513d162536d4a, entries=13, sequenceid=66, filesize=5.6 K 2024-01-14 05:56:40,278 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 133ms, sequenceid=66, compaction requested=false 2024-01-14 05:56:40,285 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-01-14 05:56:40,286 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-01-14 05:56:40,286 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-01-14 05:56:40,286 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-01-14 05:56:40,286 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-01-14 05:56:40,346 DEBUG [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1507): Waiting on 429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:56:40,547 DEBUG [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1507): Waiting on 429487984ddaf9a6bdc704a947dc5279 2024-01-14 05:56:40,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/.tmp/q/f9d69fa0713d4f88a6d57378687ff40e 2024-01-14 05:56:40,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9d69fa0713d4f88a6d57378687ff40e 2024-01-14 05:56:40,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/.tmp/u/4e03d52bec4a480895f0fb941fd85193 2024-01-14 05:56:40,665 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2024-01-14 05:56:40,665 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2024-01-14 05:56:40,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e03d52bec4a480895f0fb941fd85193 2024-01-14 05:56:40,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/.tmp/q/f9d69fa0713d4f88a6d57378687ff40e as hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/q/f9d69fa0713d4f88a6d57378687ff40e 2024-01-14 05:56:40,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9d69fa0713d4f88a6d57378687ff40e 2024-01-14 05:56:40,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/q/f9d69fa0713d4f88a6d57378687ff40e, entries=5, sequenceid=17, filesize=5.1 K 2024-01-14 05:56:40,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/.tmp/u/4e03d52bec4a480895f0fb941fd85193 as hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/u/4e03d52bec4a480895f0fb941fd85193 2024-01-14 05:56:40,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e03d52bec4a480895f0fb941fd85193 2024-01-14 05:56:40,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/u/4e03d52bec4a480895f0fb941fd85193, entries=4, sequenceid=17, filesize=5.0 K 2024-01-14 05:56:40,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 429487984ddaf9a6bdc704a947dc5279 in 469ms, sequenceid=17, compaction requested=false 2024-01-14 05:56:40,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/data/hbase/quota/429487984ddaf9a6bdc704a947dc5279/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-01-14 05:56:40,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. 2024-01-14 05:56:40,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 429487984ddaf9a6bdc704a947dc5279: 2024-01-14 05:56:40,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1705211733877.429487984ddaf9a6bdc704a947dc5279. 2024-01-14 05:56:40,747 INFO [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,38377,1705211730222; all regions closed. 2024-01-14 05:56:40,747 DEBUG [RS:0;jenkins-hbase4:38377] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-01-14 05:56:40,753 DEBUG [RS:0;jenkins-hbase4:38377] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/oldWALs 2024-01-14 05:56:40,753 INFO [RS:0;jenkins-hbase4:38377] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38377%2C1705211730222.meta:.meta(num 1705211732892) 2024-01-14 05:56:40,759 DEBUG [RS:0;jenkins-hbase4:38377] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/oldWALs 2024-01-14 05:56:40,759 INFO [RS:0;jenkins-hbase4:38377] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38377%2C1705211730222:(num 1705211732769) 2024-01-14 05:56:40,759 DEBUG [RS:0;jenkins-hbase4:38377] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 05:56:40,759 INFO [RS:0;jenkins-hbase4:38377] regionserver.LeaseManager(133): Closed leases 2024-01-14 05:56:40,759 INFO [RS:0;jenkins-hbase4:38377] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-01-14 05:56:40,759 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-14 05:56:40,760 INFO [RS:0;jenkins-hbase4:38377] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38377 2024-01-14 05:56:40,762 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38377,1705211730222 2024-01-14 05:56:40,762 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-14 05:56:40,763 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38377,1705211730222] 2024-01-14 05:56:40,763 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38377,1705211730222; numProcessing=2 2024-01-14 05:56:40,765 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38377,1705211730222 already deleted, retry=false 2024-01-14 05:56:40,765 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,38377,1705211730222 expired; onlineServers=0 2024-01-14 05:56:40,765 INFO [RegionServerTracker-0] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,44089,1705211729063' ***** 2024-01-14 05:56:40,765 INFO [RegionServerTracker-0] regionserver.HRegionServer(2314): STOPPED: Cluster shutdown set; onlineServer=0 2024-01-14 05:56:40,766 DEBUG [M:0;jenkins-hbase4:44089] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@441735c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-14 05:56:40,766 INFO [M:0;jenkins-hbase4:44089] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,44089,1705211729063 2024-01-14 05:56:40,766 INFO [M:0;jenkins-hbase4:44089] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,44089,1705211729063; all regions closed. 2024-01-14 05:56:40,766 DEBUG [M:0;jenkins-hbase4:44089] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 05:56:40,766 DEBUG [M:0;jenkins-hbase4:44089] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-01-14 05:56:40,767 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-01-14 05:56:40,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1705211732394] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1705211732394,5,FailOnTimeoutGroup] 2024-01-14 05:56:40,767 DEBUG [M:0;jenkins-hbase4:44089] cleaner.HFileCleaner(317): Stopping file delete threads 2024-01-14 05:56:40,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1705211732393] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1705211732393,5,FailOnTimeoutGroup] 2024-01-14 05:56:40,767 INFO [M:0;jenkins-hbase4:44089] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-01-14 05:56:40,767 INFO [M:0;jenkins-hbase4:44089] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-01-14 05:56:40,767 INFO [M:0;jenkins-hbase4:44089] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-01-14 05:56:40,767 DEBUG [M:0;jenkins-hbase4:44089] master.HMaster(1517): Stopping service threads 2024-01-14 05:56:40,767 INFO [M:0;jenkins-hbase4:44089] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-01-14 05:56:40,767 ERROR [M:0;jenkins-hbase4:44089] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-01-14 05:56:40,768 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-01-14 05:56:40,768 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 05:56:40,768 INFO [M:0;jenkins-hbase4:44089] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-01-14 05:56:40,768 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-01-14 05:56:40,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-14 05:56:40,768 DEBUG [M:0;jenkins-hbase4:44089] zookeeper.ZKUtil(399): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-01-14 05:56:40,769 WARN [M:0;jenkins-hbase4:44089] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-01-14 05:56:40,769 INFO [M:0;jenkins-hbase4:44089] assignment.AssignmentManager(315): Stopping assignment manager 2024-01-14 05:56:40,769 INFO [M:0;jenkins-hbase4:44089] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-01-14 05:56:40,769 DEBUG [M:0;jenkins-hbase4:44089] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-01-14 05:56:40,769 INFO [M:0;jenkins-hbase4:44089] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 05:56:40,769 DEBUG [M:0;jenkins-hbase4:44089] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 05:56:40,769 DEBUG [M:0;jenkins-hbase4:44089] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-01-14 05:56:40,769 DEBUG [M:0;jenkins-hbase4:44089] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 05:56:40,769 INFO [M:0;jenkins-hbase4:44089] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=152.90 KB heapSize=184.74 KB 2024-01-14 05:56:40,783 INFO [M:0;jenkins-hbase4:44089] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=152.90 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5eba6025399c48e386318859176dfac2 2024-01-14 05:56:40,789 INFO [M:0;jenkins-hbase4:44089] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5eba6025399c48e386318859176dfac2 2024-01-14 05:56:40,790 DEBUG [M:0;jenkins-hbase4:44089] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5eba6025399c48e386318859176dfac2 as hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5eba6025399c48e386318859176dfac2 2024-01-14 05:56:40,796 INFO [M:0;jenkins-hbase4:44089] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5eba6025399c48e386318859176dfac2 2024-01-14 05:56:40,796 INFO [M:0;jenkins-hbase4:44089] regionserver.HStore(1080): Added hdfs://localhost:37135/user/jenkins/test-data/f59ed306-a916-3f8d-e90c-8d41c3ec3fbd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5eba6025399c48e386318859176dfac2, entries=45, sequenceid=376, filesize=12.0 K 2024-01-14 05:56:40,797 INFO [M:0;jenkins-hbase4:44089] regionserver.HRegion(2948): Finished flush of dataSize ~152.90 KB/156572, heapSize ~184.73 KB/189160, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=376, compaction requested=false 2024-01-14 05:56:40,798 INFO [M:0;jenkins-hbase4:44089] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 05:56:40,798 DEBUG [M:0;jenkins-hbase4:44089] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-14 05:56:40,801 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-14 05:56:40,801 INFO [M:0;jenkins-hbase4:44089] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-01-14 05:56:40,802 INFO [M:0;jenkins-hbase4:44089] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44089 2024-01-14 05:56:40,803 DEBUG [M:0;jenkins-hbase4:44089] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44089,1705211729063 already deleted, retry=false 2024-01-14 05:56:40,865 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-14 05:56:40,865 INFO [RS:0;jenkins-hbase4:38377] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,38377,1705211730222; zookeeper connection closed. 2024-01-14 05:56:40,865 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:38377-0x1012499f55f0001, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-14 05:56:40,865 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2dba95ba] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2dba95ba 2024-01-14 05:56:40,865 INFO [Listener at localhost/35313] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-01-14 05:56:40,906 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-14 05:56:40,906 INFO [M:0;jenkins-hbase4:44089] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,44089,1705211729063; zookeeper connection closed. 2024-01-14 05:56:40,906 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:44089-0x1012499f55f0000, quorum=127.0.0.1:52071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-14 05:56:40,908 WARN [Listener at localhost/35313] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-01-14 05:56:40,911 INFO [Listener at localhost/35313] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-14 05:56:41,015 WARN [BP-448150119-172.31.14.131-1705211725929 heartbeating to localhost/127.0.0.1:37135] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-01-14 05:56:41,016 WARN [BP-448150119-172.31.14.131-1705211725929 heartbeating to localhost/127.0.0.1:37135] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-448150119-172.31.14.131-1705211725929 (Datanode Uuid afdad90d-b1c5-4a9c-8bfd-dc59ece2a80e) service to localhost/127.0.0.1:37135 2024-01-14 05:56:41,018 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/cluster_86bc26f8-88aa-e80f-6465-53e5bf824867/dfs/data/data3/current/BP-448150119-172.31.14.131-1705211725929] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-14 05:56:41,018 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/cluster_86bc26f8-88aa-e80f-6465-53e5bf824867/dfs/data/data4/current/BP-448150119-172.31.14.131-1705211725929] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-14 05:56:41,019 WARN [Listener at localhost/35313] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-01-14 05:56:41,021 INFO [Listener at localhost/35313] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-14 05:56:41,125 WARN [BP-448150119-172.31.14.131-1705211725929 heartbeating to localhost/127.0.0.1:37135] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-01-14 05:56:41,125 WARN [BP-448150119-172.31.14.131-1705211725929 heartbeating to localhost/127.0.0.1:37135] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-448150119-172.31.14.131-1705211725929 (Datanode Uuid 49504216-a62f-4fec-b4cd-addce9afabb1) service to localhost/127.0.0.1:37135 2024-01-14 05:56:41,126 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/cluster_86bc26f8-88aa-e80f-6465-53e5bf824867/dfs/data/data1/current/BP-448150119-172.31.14.131-1705211725929] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-14 05:56:41,126 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53cdbd34-b0f6-4005-3aba-ccc5072e2c01/cluster_86bc26f8-88aa-e80f-6465-53e5bf824867/dfs/data/data2/current/BP-448150119-172.31.14.131-1705211725929] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-14 05:56:41,165 INFO [Listener at localhost/35313] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-14 05:56:41,279 INFO [Listener at localhost/35313] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-01-14 05:56:41,318 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1293): Minicluster is down