2024-04-15 05:52:47,630 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-04-15 05:52:47,864 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043 2024-04-15 05:52:47,876 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-04-15 05:52:47,876 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/cluster_fd9b8b7d-3cdf-2ce6-b5b3-d89354f8bc33, deleteOnExit=true 2024-04-15 05:52:47,876 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-04-15 05:52:47,877 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/test.cache.data in system properties and HBase conf 2024-04-15 05:52:47,877 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/hadoop.tmp.dir in system properties and HBase conf 2024-04-15 05:52:47,878 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/hadoop.log.dir in system properties and HBase conf 2024-04-15 05:52:47,879 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/mapreduce.cluster.local.dir in system properties and HBase conf 2024-04-15 05:52:47,879 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-04-15 05:52:47,879 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-04-15 05:52:47,994 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-04-15 05:52:48,410 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-04-15 05:52:48,416 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-04-15 05:52:48,416 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-04-15 05:52:48,417 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-04-15 05:52:48,417 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-04-15 05:52:48,417 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-04-15 05:52:48,418 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-04-15 05:52:48,418 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-04-15 05:52:48,419 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/dfs.journalnode.edits.dir in system properties and HBase conf 2024-04-15 05:52:48,419 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-04-15 05:52:48,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/nfs.dump.dir in system properties and HBase conf 2024-04-15 05:52:48,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/java.io.tmpdir in system properties and HBase conf 2024-04-15 05:52:48,421 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/dfs.journalnode.edits.dir in system properties and HBase conf 2024-04-15 05:52:48,421 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-04-15 05:52:48,422 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-04-15 05:52:49,020 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-04-15 05:52:49,027 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-04-15 05:52:49,272 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-04-15 05:52:49,432 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-04-15 05:52:49,451 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-04-15 05:52:49,483 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-04-15 05:52:49,510 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/java.io.tmpdir/Jetty_localhost_33309_hdfs____.i8xj5m/webapp 2024-04-15 05:52:49,616 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33309 2024-04-15 05:52:49,624 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-04-15 05:52:49,625 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-04-15 05:52:50,007 WARN [Listener at localhost/40455] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-04-15 05:52:50,087 WARN [Listener at localhost/40455] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-04-15 05:52:50,109 WARN [Listener at localhost/40455] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-04-15 05:52:50,119 INFO [Listener at localhost/40455] log.Slf4jLog(67): jetty-6.1.26 2024-04-15 05:52:50,124 INFO [Listener at localhost/40455] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/java.io.tmpdir/Jetty_localhost_41121_datanode____81y3ui/webapp 2024-04-15 05:52:50,206 INFO [Listener at localhost/40455] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41121 2024-04-15 05:52:50,548 WARN [Listener at localhost/42925] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-04-15 05:52:50,576 WARN [Listener at localhost/42925] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-04-15 05:52:50,582 WARN [Listener at localhost/42925] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-04-15 05:52:50,585 INFO [Listener at localhost/42925] log.Slf4jLog(67): jetty-6.1.26 2024-04-15 05:52:50,601 INFO [Listener at localhost/42925] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/java.io.tmpdir/Jetty_localhost_42655_datanode____8qxnun/webapp 2024-04-15 05:52:50,716 INFO [Listener at localhost/42925] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42655 2024-04-15 05:52:50,747 WARN [Listener at localhost/41827] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-04-15 05:52:51,093 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xce5a08ec610b24ea: Processing first storage report for DS-acb520b0-1646-4b2b-addf-206ccf8930ba from datanode 89afc542-4c7f-4c71-852b-ba77057224dd 2024-04-15 05:52:51,095 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xce5a08ec610b24ea: from storage DS-acb520b0-1646-4b2b-addf-206ccf8930ba node DatanodeRegistration(127.0.0.1:46369, datanodeUuid=89afc542-4c7f-4c71-852b-ba77057224dd, infoPort=44885, infoSecurePort=0, ipcPort=42925, storageInfo=lv=-57;cid=testClusterID;nsid=1987482528;c=1713160369090), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-04-15 05:52:51,095 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa1da1aed87a3f84c: Processing first storage report for DS-72aec063-4757-46ba-bea4-582cbbb64775 from datanode 9e0f8a13-091f-425b-b3ed-85e5d51edbba 2024-04-15 05:52:51,096 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa1da1aed87a3f84c: from storage DS-72aec063-4757-46ba-bea4-582cbbb64775 node DatanodeRegistration(127.0.0.1:39017, datanodeUuid=9e0f8a13-091f-425b-b3ed-85e5d51edbba, infoPort=33915, infoSecurePort=0, ipcPort=41827, storageInfo=lv=-57;cid=testClusterID;nsid=1987482528;c=1713160369090), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-04-15 05:52:51,096 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa1da1aed87a3f84c: Processing first storage report for DS-31cc29cf-ccf3-458a-bc5f-62af43408c29 from datanode 9e0f8a13-091f-425b-b3ed-85e5d51edbba 2024-04-15 05:52:51,096 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa1da1aed87a3f84c: from storage DS-31cc29cf-ccf3-458a-bc5f-62af43408c29 node DatanodeRegistration(127.0.0.1:39017, datanodeUuid=9e0f8a13-091f-425b-b3ed-85e5d51edbba, infoPort=33915, infoSecurePort=0, ipcPort=41827, storageInfo=lv=-57;cid=testClusterID;nsid=1987482528;c=1713160369090), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-04-15 05:52:51,096 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xce5a08ec610b24ea: Processing first storage report for DS-56958a78-3baa-4a8b-a02b-41309e87fb51 from datanode 89afc542-4c7f-4c71-852b-ba77057224dd 2024-04-15 05:52:51,096 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xce5a08ec610b24ea: from storage DS-56958a78-3baa-4a8b-a02b-41309e87fb51 node DatanodeRegistration(127.0.0.1:46369, datanodeUuid=89afc542-4c7f-4c71-852b-ba77057224dd, infoPort=44885, infoSecurePort=0, ipcPort=42925, storageInfo=lv=-57;cid=testClusterID;nsid=1987482528;c=1713160369090), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2024-04-15 05:52:51,438 DEBUG [Listener at localhost/41827] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043 2024-04-15 05:52:51,591 INFO [Listener at localhost/41827] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/cluster_fd9b8b7d-3cdf-2ce6-b5b3-d89354f8bc33/zookeeper_0, clientPort=62954, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/cluster_fd9b8b7d-3cdf-2ce6-b5b3-d89354f8bc33/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/cluster_fd9b8b7d-3cdf-2ce6-b5b3-d89354f8bc33/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-04-15 05:52:51,609 INFO [Listener at localhost/41827] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62954 2024-04-15 05:52:51,617 INFO [Listener at localhost/41827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-15 05:52:51,619 INFO [Listener at localhost/41827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-15 05:52:52,268 INFO [Listener at localhost/41827] util.FSUtils(471): Created version file at hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8 with version=8 2024-04-15 05:52:52,268 INFO [Listener at localhost/41827] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/hbase-staging 2024-04-15 05:52:52,575 INFO [Listener at localhost/41827] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-04-15 05:52:52,981 INFO [Listener at localhost/41827] client.ConnectionUtils(126): master/jenkins-hbase20:0 server-side Connection retries=45 2024-04-15 05:52:53,012 INFO [Listener at localhost/41827] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-15 05:52:53,013 INFO [Listener at localhost/41827] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-04-15 05:52:53,013 INFO [Listener at localhost/41827] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-04-15 05:52:53,013 INFO [Listener at localhost/41827] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-15 05:52:53,014 INFO [Listener at localhost/41827] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-04-15 05:52:53,166 INFO [Listener at localhost/41827] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-04-15 05:52:53,231 DEBUG [Listener at localhost/41827] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-04-15 05:52:53,318 INFO [Listener at localhost/41827] ipc.NettyRpcServer(120): Bind to /148.251.75.209:33599 2024-04-15 05:52:53,327 INFO [Listener at localhost/41827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-15 05:52:53,329 INFO [Listener at localhost/41827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-15 05:52:53,353 INFO [Listener at localhost/41827] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33599 connecting to ZooKeeper ensemble=127.0.0.1:62954 2024-04-15 05:52:53,406 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:335990x0, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-04-15 05:52:53,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33599-0x10105aefe180000 connected 2024-04-15 05:52:53,448 DEBUG [Listener at localhost/41827] zookeeper.ZKUtil(165): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-15 05:52:53,449 DEBUG [Listener at localhost/41827] zookeeper.ZKUtil(165): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-15 05:52:53,452 DEBUG [Listener at localhost/41827] zookeeper.ZKUtil(165): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-04-15 05:52:53,462 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33599 2024-04-15 05:52:53,466 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33599 2024-04-15 05:52:53,467 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33599 2024-04-15 05:52:53,467 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33599 2024-04-15 05:52:53,467 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33599 2024-04-15 05:52:53,473 INFO [Listener at localhost/41827] master.HMaster(445): hbase.rootdir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8, hbase.cluster.distributed=false 2024-04-15 05:52:53,550 INFO [Listener at localhost/41827] client.ConnectionUtils(126): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2024-04-15 05:52:53,550 INFO [Listener at localhost/41827] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-15 05:52:53,550 INFO [Listener at localhost/41827] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-04-15 05:52:53,551 INFO [Listener at localhost/41827] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-04-15 05:52:53,551 INFO [Listener at localhost/41827] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-15 05:52:53,551 INFO [Listener at localhost/41827] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-04-15 05:52:53,556 INFO [Listener at localhost/41827] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-04-15 05:52:53,559 INFO [Listener at localhost/41827] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38727 2024-04-15 05:52:53,561 INFO [Listener at localhost/41827] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-04-15 05:52:53,569 DEBUG [Listener at localhost/41827] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-04-15 05:52:53,571 INFO [Listener at localhost/41827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-15 05:52:53,573 INFO [Listener at localhost/41827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-15 05:52:53,576 INFO [Listener at localhost/41827] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38727 connecting to ZooKeeper ensemble=127.0.0.1:62954 2024-04-15 05:52:53,582 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:387270x0, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-04-15 05:52:53,583 DEBUG [Listener at localhost/41827] zookeeper.ZKUtil(165): regionserver:387270x0, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-15 05:52:53,587 DEBUG [Listener at localhost/41827] zookeeper.ZKUtil(165): regionserver:387270x0, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-15 05:52:53,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38727-0x10105aefe180001 connected 2024-04-15 05:52:53,590 DEBUG [Listener at localhost/41827] zookeeper.ZKUtil(165): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-04-15 05:52:53,591 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38727 2024-04-15 05:52:53,594 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38727 2024-04-15 05:52:53,604 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38727 2024-04-15 05:52:53,605 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38727 2024-04-15 05:52:53,606 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38727 2024-04-15 05:52:53,618 INFO [Listener at localhost/41827] client.ConnectionUtils(126): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2024-04-15 05:52:53,619 INFO [Listener at localhost/41827] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-15 05:52:53,619 INFO [Listener at localhost/41827] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-04-15 05:52:53,619 INFO [Listener at localhost/41827] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-04-15 05:52:53,619 INFO [Listener at localhost/41827] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-15 05:52:53,620 INFO [Listener at localhost/41827] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-04-15 05:52:53,620 INFO [Listener at localhost/41827] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-04-15 05:52:53,622 INFO [Listener at localhost/41827] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41783 2024-04-15 05:52:53,622 INFO [Listener at localhost/41827] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-04-15 05:52:53,631 DEBUG [Listener at localhost/41827] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-04-15 05:52:53,632 INFO [Listener at localhost/41827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-15 05:52:53,634 INFO [Listener at localhost/41827] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-15 05:52:53,638 INFO [Listener at localhost/41827] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41783 connecting to ZooKeeper ensemble=127.0.0.1:62954 2024-04-15 05:52:53,643 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:417830x0, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-04-15 05:52:53,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41783-0x10105aefe180002 connected 2024-04-15 05:52:53,645 DEBUG [Listener at localhost/41827] zookeeper.ZKUtil(165): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-15 05:52:53,646 DEBUG [Listener at localhost/41827] zookeeper.ZKUtil(165): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-15 05:52:53,647 DEBUG [Listener at localhost/41827] zookeeper.ZKUtil(165): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-04-15 05:52:53,650 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41783 2024-04-15 05:52:53,650 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41783 2024-04-15 05:52:53,654 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41783 2024-04-15 05:52:53,660 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41783 2024-04-15 05:52:53,660 DEBUG [Listener at localhost/41827] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41783 2024-04-15 05:52:53,662 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,33599,1713160372399 2024-04-15 05:52:53,673 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-04-15 05:52:53,675 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,33599,1713160372399 2024-04-15 05:52:53,704 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-04-15 05:52:53,704 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-04-15 05:52:53,704 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-15 05:52:53,704 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-04-15 05:52:53,707 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-04-15 05:52:53,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-04-15 05:52:53,713 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,33599,1713160372399 from backup master directory 2024-04-15 05:52:53,721 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,33599,1713160372399 2024-04-15 05:52:53,721 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-04-15 05:52:53,722 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-04-15 05:52:53,722 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,33599,1713160372399 2024-04-15 05:52:53,725 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-04-15 05:52:53,726 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-04-15 05:52:53,827 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/hbase.id with ID: 62f44099-248e-4057-9037-d4ef12f06833 2024-04-15 05:52:53,878 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-15 05:52:53,895 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-15 05:52:53,940 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x288b7a79 to 127.0.0.1:62954 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-15 05:52:53,973 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cf3db6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:53,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-15 05:52:54,000 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-04-15 05:52:54,019 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-04-15 05:52:54,019 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-04-15 05:52:54,021 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-04-15 05:52:54,026 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-04-15 05:52:54,027 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-15 05:52:54,074 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/data/master/store-tmp 2024-04-15 05:52:54,113 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:54,114 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-04-15 05:52:54,114 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-15 05:52:54,114 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-15 05:52:54,114 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-04-15 05:52:54,114 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-15 05:52:54,114 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-15 05:52:54,114 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-04-15 05:52:54,116 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/WALs/jenkins-hbase20.apache.org,33599,1713160372399 2024-04-15 05:52:54,140 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33599%2C1713160372399, suffix=, logDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/WALs/jenkins-hbase20.apache.org,33599,1713160372399, archiveDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/oldWALs, maxLogs=10 2024-04-15 05:52:54,214 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39017,DS-72aec063-4757-46ba-bea4-582cbbb64775,DISK] 2024-04-15 05:52:54,214 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46369,DS-acb520b0-1646-4b2b-addf-206ccf8930ba,DISK] 2024-04-15 05:52:54,223 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-04-15 05:52:54,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/WALs/jenkins-hbase20.apache.org,33599,1713160372399/jenkins-hbase20.apache.org%2C33599%2C1713160372399.1713160374151 2024-04-15 05:52:54,292 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46369,DS-acb520b0-1646-4b2b-addf-206ccf8930ba,DISK], DatanodeInfoWithStorage[127.0.0.1:39017,DS-72aec063-4757-46ba-bea4-582cbbb64775,DISK]] 2024-04-15 05:52:54,292 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-04-15 05:52:54,293 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:54,296 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-04-15 05:52:54,297 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-04-15 05:52:54,374 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-04-15 05:52:54,384 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-04-15 05:52:54,407 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-04-15 05:52:54,419 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:54,424 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-04-15 05:52:54,426 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-04-15 05:52:54,443 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-04-15 05:52:54,448 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-15 05:52:54,450 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67268116, jitterRate=0.002373039722442627}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-15 05:52:54,450 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-04-15 05:52:54,452 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-04-15 05:52:54,471 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-04-15 05:52:54,471 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-04-15 05:52:54,473 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-04-15 05:52:54,475 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-04-15 05:52:54,511 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 35 msec 2024-04-15 05:52:54,511 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-04-15 05:52:54,537 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-04-15 05:52:54,543 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-04-15 05:52:54,571 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-04-15 05:52:54,577 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-04-15 05:52:54,579 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-04-15 05:52:54,585 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-04-15 05:52:54,591 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-04-15 05:52:54,595 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-15 05:52:54,597 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-04-15 05:52:54,597 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-04-15 05:52:54,611 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-04-15 05:52:54,616 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-04-15 05:52:54,616 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-04-15 05:52:54,616 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-04-15 05:52:54,617 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-15 05:52:54,618 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase20.apache.org,33599,1713160372399, sessionid=0x10105aefe180000, setting cluster-up flag (Was=false) 2024-04-15 05:52:54,640 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-15 05:52:54,646 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-04-15 05:52:54,648 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,33599,1713160372399 2024-04-15 05:52:54,671 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-15 05:52:54,676 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-04-15 05:52:54,677 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,33599,1713160372399 2024-04-15 05:52:54,680 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.hbase-snapshot/.tmp 2024-04-15 05:52:54,738 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-04-15 05:52:54,765 INFO [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(954): ClusterId : 62f44099-248e-4057-9037-d4ef12f06833 2024-04-15 05:52:54,767 INFO [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(954): ClusterId : 62f44099-248e-4057-9037-d4ef12f06833 2024-04-15 05:52:54,771 DEBUG [RS:1;jenkins-hbase20:41783] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-04-15 05:52:54,771 DEBUG [RS:0;jenkins-hbase20:38727] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-04-15 05:52:54,778 DEBUG [RS:1;jenkins-hbase20:41783] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-04-15 05:52:54,778 DEBUG [RS:0;jenkins-hbase20:38727] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-04-15 05:52:54,778 DEBUG [RS:1;jenkins-hbase20:41783] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-04-15 05:52:54,778 DEBUG [RS:0;jenkins-hbase20:38727] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-04-15 05:52:54,781 DEBUG [RS:1;jenkins-hbase20:41783] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-04-15 05:52:54,781 DEBUG [RS:0;jenkins-hbase20:38727] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-04-15 05:52:54,784 DEBUG [RS:0;jenkins-hbase20:38727] zookeeper.ReadOnlyZKClient(139): Connect 0x34a39370 to 127.0.0.1:62954 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-15 05:52:54,784 DEBUG [RS:1;jenkins-hbase20:41783] zookeeper.ReadOnlyZKClient(139): Connect 0x66b696ee to 127.0.0.1:62954 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-15 05:52:54,804 DEBUG [RS:1;jenkins-hbase20:41783] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68717448, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:54,805 DEBUG [RS:1;jenkins-hbase20:41783] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c4efd9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2024-04-15 05:52:54,807 DEBUG [RS:0;jenkins-hbase20:38727] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a646b94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:54,807 DEBUG [RS:0;jenkins-hbase20:38727] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e5bf800, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2024-04-15 05:52:54,827 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-04-15 05:52:54,829 DEBUG [RS:1;jenkins-hbase20:41783] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:41783 2024-04-15 05:52:54,831 DEBUG [RS:0;jenkins-hbase20:38727] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:38727 2024-04-15 05:52:54,834 INFO [RS:1;jenkins-hbase20:41783] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-04-15 05:52:54,834 INFO [RS:0;jenkins-hbase20:38727] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-04-15 05:52:54,835 INFO [RS:1;jenkins-hbase20:41783] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-04-15 05:52:54,835 INFO [RS:0;jenkins-hbase20:38727] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-04-15 05:52:54,835 DEBUG [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(1025): About to register with Master. 2024-04-15 05:52:54,835 DEBUG [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(1025): About to register with Master. 2024-04-15 05:52:54,838 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2024-04-15 05:52:54,838 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2024-04-15 05:52:54,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2024-04-15 05:52:54,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2024-04-15 05:52:54,839 INFO [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase20.apache.org,33599,1713160372399 with isa=jenkins-hbase20.apache.org/148.251.75.209:41783, startcode=1713160373618 2024-04-15 05:52:54,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2024-04-15 05:52:54,839 INFO [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase20.apache.org,33599,1713160372399 with isa=jenkins-hbase20.apache.org/148.251.75.209:38727, startcode=1713160373549 2024-04-15 05:52:54,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:54,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2024-04-15 05:52:54,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:54,840 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1713160404840 2024-04-15 05:52:54,844 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-04-15 05:52:54,846 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-04-15 05:52:54,847 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-04-15 05:52:54,854 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-04-15 05:52:54,858 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-04-15 05:52:54,863 DEBUG [RS:0;jenkins-hbase20:38727] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-04-15 05:52:54,864 DEBUG [RS:1;jenkins-hbase20:41783] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-04-15 05:52:54,870 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-04-15 05:52:54,871 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-04-15 05:52:54,871 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-04-15 05:52:54,871 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-04-15 05:52:54,872 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:54,875 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-04-15 05:52:54,878 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-04-15 05:52:54,878 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-04-15 05:52:54,882 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-04-15 05:52:54,883 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-04-15 05:52:54,892 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1713160374891,5,FailOnTimeoutGroup] 2024-04-15 05:52:54,899 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1713160374892,5,FailOnTimeoutGroup] 2024-04-15 05:52:54,900 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:54,900 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-04-15 05:52:54,902 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:54,902 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:54,939 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-04-15 05:52:54,941 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-04-15 05:52:54,942 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8 2024-04-15 05:52:54,957 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44483, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-04-15 05:52:54,957 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36451, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-04-15 05:52:54,984 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33599] master.ServerManager(404): Registering regionserver=jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:55,001 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:55,004 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-04-15 05:52:55,006 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33599] master.ServerManager(404): Registering regionserver=jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:55,015 DEBUG [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8 2024-04-15 05:52:55,015 DEBUG [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:40455 2024-04-15 05:52:55,015 DEBUG [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-04-15 05:52:55,016 DEBUG [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8 2024-04-15 05:52:55,016 DEBUG [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:40455 2024-04-15 05:52:55,016 DEBUG [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-04-15 05:52:55,011 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/info 2024-04-15 05:52:55,017 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-04-15 05:52:55,019 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:55,020 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-04-15 05:52:55,023 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-15 05:52:55,025 DEBUG [RS:0;jenkins-hbase20:38727] zookeeper.ZKUtil(163): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:55,025 WARN [RS:0;jenkins-hbase20:38727] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-04-15 05:52:55,027 INFO [RS:0;jenkins-hbase20:38727] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-15 05:52:55,027 DEBUG [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(1950): logDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/WALs/jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:55,028 DEBUG [RS:1;jenkins-hbase20:41783] zookeeper.ZKUtil(163): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:55,029 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38727,1713160373549] 2024-04-15 05:52:55,030 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,41783,1713160373618] 2024-04-15 05:52:55,030 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/rep_barrier 2024-04-15 05:52:55,028 WARN [RS:1;jenkins-hbase20:41783] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-04-15 05:52:55,031 INFO [RS:1;jenkins-hbase20:41783] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-15 05:52:55,032 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-04-15 05:52:55,032 DEBUG [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(1950): logDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/WALs/jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:55,034 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:55,035 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-04-15 05:52:55,046 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/table 2024-04-15 05:52:55,047 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-04-15 05:52:55,051 DEBUG [RS:1;jenkins-hbase20:41783] zookeeper.ZKUtil(163): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:55,051 DEBUG [RS:1;jenkins-hbase20:41783] zookeeper.ZKUtil(163): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:55,055 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:55,058 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740 2024-04-15 05:52:55,060 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740 2024-04-15 05:52:55,073 DEBUG [RS:1;jenkins-hbase20:41783] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-04-15 05:52:55,075 DEBUG [RS:0;jenkins-hbase20:38727] zookeeper.ZKUtil(163): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:55,077 DEBUG [RS:0;jenkins-hbase20:38727] zookeeper.ZKUtil(163): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:55,079 DEBUG [RS:0;jenkins-hbase20:38727] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-04-15 05:52:55,082 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-04-15 05:52:55,086 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-04-15 05:52:55,087 INFO [RS:0;jenkins-hbase20:38727] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-04-15 05:52:55,087 INFO [RS:1;jenkins-hbase20:41783] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-04-15 05:52:55,093 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-15 05:52:55,095 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70268829, jitterRate=0.04708714783191681}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-04-15 05:52:55,095 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-04-15 05:52:55,095 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-04-15 05:52:55,095 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-04-15 05:52:55,096 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-04-15 05:52:55,096 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-04-15 05:52:55,096 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-04-15 05:52:55,108 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-04-15 05:52:55,108 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-04-15 05:52:55,118 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-04-15 05:52:55,118 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-04-15 05:52:55,120 INFO [RS:1;jenkins-hbase20:41783] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-04-15 05:52:55,120 INFO [RS:0;jenkins-hbase20:38727] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-04-15 05:52:55,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-04-15 05:52:55,129 INFO [RS:1;jenkins-hbase20:41783] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-04-15 05:52:55,129 INFO [RS:0;jenkins-hbase20:38727] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-04-15 05:52:55,129 INFO [RS:1;jenkins-hbase20:41783] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,129 INFO [RS:0;jenkins-hbase20:38727] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,131 INFO [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-04-15 05:52:55,133 INFO [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-04-15 05:52:55,142 INFO [RS:0;jenkins-hbase20:38727] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,142 DEBUG [RS:0;jenkins-hbase20:38727] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,142 DEBUG [RS:0;jenkins-hbase20:38727] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,143 DEBUG [RS:0;jenkins-hbase20:38727] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,143 DEBUG [RS:0;jenkins-hbase20:38727] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,143 DEBUG [RS:0;jenkins-hbase20:38727] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,143 DEBUG [RS:0;jenkins-hbase20:38727] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2024-04-15 05:52:55,143 DEBUG [RS:0;jenkins-hbase20:38727] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,144 DEBUG [RS:0;jenkins-hbase20:38727] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,144 DEBUG [RS:0;jenkins-hbase20:38727] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,144 DEBUG [RS:0;jenkins-hbase20:38727] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,144 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-04-15 05:52:55,147 INFO [RS:1;jenkins-hbase20:41783] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,147 DEBUG [RS:1;jenkins-hbase20:41783] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,148 DEBUG [RS:1;jenkins-hbase20:41783] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,148 DEBUG [RS:1;jenkins-hbase20:41783] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,148 DEBUG [RS:1;jenkins-hbase20:41783] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,148 DEBUG [RS:1;jenkins-hbase20:41783] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,148 DEBUG [RS:1;jenkins-hbase20:41783] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2024-04-15 05:52:55,149 DEBUG [RS:1;jenkins-hbase20:41783] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,149 DEBUG [RS:1;jenkins-hbase20:41783] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,149 DEBUG [RS:1;jenkins-hbase20:41783] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,149 DEBUG [RS:1;jenkins-hbase20:41783] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2024-04-15 05:52:55,149 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-04-15 05:52:55,159 INFO [RS:0;jenkins-hbase20:38727] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,159 INFO [RS:0;jenkins-hbase20:38727] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,159 INFO [RS:0;jenkins-hbase20:38727] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,159 INFO [RS:0;jenkins-hbase20:38727] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,160 INFO [RS:1;jenkins-hbase20:41783] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,160 INFO [RS:1;jenkins-hbase20:41783] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,160 INFO [RS:1;jenkins-hbase20:41783] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,160 INFO [RS:1;jenkins-hbase20:41783] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,177 INFO [RS:0;jenkins-hbase20:38727] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-04-15 05:52:55,177 INFO [RS:1;jenkins-hbase20:41783] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-04-15 05:52:55,180 INFO [RS:1;jenkins-hbase20:41783] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41783,1713160373618-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,180 INFO [RS:0;jenkins-hbase20:38727] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38727,1713160373549-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,204 INFO [RS:0;jenkins-hbase20:38727] regionserver.Replication(203): jenkins-hbase20.apache.org,38727,1713160373549 started 2024-04-15 05:52:55,204 INFO [RS:1;jenkins-hbase20:41783] regionserver.Replication(203): jenkins-hbase20.apache.org,41783,1713160373618 started 2024-04-15 05:52:55,205 INFO [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(1640): Serving as jenkins-hbase20.apache.org,38727,1713160373549, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38727, sessionid=0x10105aefe180001 2024-04-15 05:52:55,205 INFO [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(1640): Serving as jenkins-hbase20.apache.org,41783,1713160373618, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:41783, sessionid=0x10105aefe180002 2024-04-15 05:52:55,205 DEBUG [RS:0;jenkins-hbase20:38727] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-04-15 05:52:55,205 DEBUG [RS:1;jenkins-hbase20:41783] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-04-15 05:52:55,205 DEBUG [RS:0;jenkins-hbase20:38727] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:55,205 DEBUG [RS:1;jenkins-hbase20:41783] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:55,206 DEBUG [RS:0;jenkins-hbase20:38727] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38727,1713160373549' 2024-04-15 05:52:55,206 DEBUG [RS:1;jenkins-hbase20:41783] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41783,1713160373618' 2024-04-15 05:52:55,206 DEBUG [RS:1;jenkins-hbase20:41783] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-04-15 05:52:55,206 DEBUG [RS:0;jenkins-hbase20:38727] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-04-15 05:52:55,207 DEBUG [RS:0;jenkins-hbase20:38727] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-04-15 05:52:55,208 DEBUG [RS:1;jenkins-hbase20:41783] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-04-15 05:52:55,208 DEBUG [RS:0;jenkins-hbase20:38727] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-04-15 05:52:55,208 DEBUG [RS:1;jenkins-hbase20:41783] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-04-15 05:52:55,208 DEBUG [RS:0;jenkins-hbase20:38727] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-04-15 05:52:55,208 DEBUG [RS:1;jenkins-hbase20:41783] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-04-15 05:52:55,209 DEBUG [RS:0;jenkins-hbase20:38727] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:55,209 DEBUG [RS:1;jenkins-hbase20:41783] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:55,209 DEBUG [RS:0;jenkins-hbase20:38727] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38727,1713160373549' 2024-04-15 05:52:55,209 DEBUG [RS:0;jenkins-hbase20:38727] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-04-15 05:52:55,209 DEBUG [RS:1;jenkins-hbase20:41783] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41783,1713160373618' 2024-04-15 05:52:55,209 DEBUG [RS:1;jenkins-hbase20:41783] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-04-15 05:52:55,210 DEBUG [RS:0;jenkins-hbase20:38727] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-04-15 05:52:55,210 DEBUG [RS:1;jenkins-hbase20:41783] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-04-15 05:52:55,211 DEBUG [RS:0;jenkins-hbase20:38727] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-04-15 05:52:55,211 INFO [RS:0;jenkins-hbase20:38727] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-04-15 05:52:55,211 DEBUG [RS:1;jenkins-hbase20:41783] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-04-15 05:52:55,214 INFO [RS:0;jenkins-hbase20:38727] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,211 INFO [RS:1;jenkins-hbase20:41783] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-04-15 05:52:55,214 INFO [RS:1;jenkins-hbase20:41783] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,215 DEBUG [RS:0;jenkins-hbase20:38727] zookeeper.ZKUtil(399): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-04-15 05:52:55,215 DEBUG [RS:1;jenkins-hbase20:41783] zookeeper.ZKUtil(399): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-04-15 05:52:55,215 INFO [RS:0;jenkins-hbase20:38727] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-04-15 05:52:55,215 INFO [RS:1;jenkins-hbase20:41783] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-04-15 05:52:55,216 INFO [RS:0;jenkins-hbase20:38727] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,216 INFO [RS:1;jenkins-hbase20:41783] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,216 INFO [RS:1;jenkins-hbase20:41783] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,216 INFO [RS:0;jenkins-hbase20:38727] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,302 DEBUG [jenkins-hbase20:33599] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-04-15 05:52:55,307 DEBUG [jenkins-hbase20:33599] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2024-04-15 05:52:55,314 DEBUG [jenkins-hbase20:33599] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-15 05:52:55,314 DEBUG [jenkins-hbase20:33599] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-15 05:52:55,314 DEBUG [jenkins-hbase20:33599] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-15 05:52:55,317 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,41783,1713160373618, state=OPENING 2024-04-15 05:52:55,325 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-04-15 05:52:55,327 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-15 05:52:55,330 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-04-15 05:52:55,330 INFO [RS:1;jenkins-hbase20:41783] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41783%2C1713160373618, suffix=, logDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/WALs/jenkins-hbase20.apache.org,41783,1713160373618, archiveDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/oldWALs, maxLogs=32 2024-04-15 05:52:55,334 INFO [RS:0;jenkins-hbase20:38727] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38727%2C1713160373549, suffix=, logDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/WALs/jenkins-hbase20.apache.org,38727,1713160373549, archiveDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/oldWALs, maxLogs=32 2024-04-15 05:52:55,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,41783,1713160373618}] 2024-04-15 05:52:55,352 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39017,DS-72aec063-4757-46ba-bea4-582cbbb64775,DISK] 2024-04-15 05:52:55,353 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46369,DS-acb520b0-1646-4b2b-addf-206ccf8930ba,DISK] 2024-04-15 05:52:55,390 INFO [RS:1;jenkins-hbase20:41783] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/WALs/jenkins-hbase20.apache.org,41783,1713160373618/jenkins-hbase20.apache.org%2C41783%2C1713160373618.1713160375333 2024-04-15 05:52:55,390 DEBUG [RS:1;jenkins-hbase20:41783] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46369,DS-acb520b0-1646-4b2b-addf-206ccf8930ba,DISK], DatanodeInfoWithStorage[127.0.0.1:39017,DS-72aec063-4757-46ba-bea4-582cbbb64775,DISK]] 2024-04-15 05:52:55,400 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46369,DS-acb520b0-1646-4b2b-addf-206ccf8930ba,DISK] 2024-04-15 05:52:55,400 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39017,DS-72aec063-4757-46ba-bea4-582cbbb64775,DISK] 2024-04-15 05:52:55,413 INFO [RS:0;jenkins-hbase20:38727] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/WALs/jenkins-hbase20.apache.org,38727,1713160373549/jenkins-hbase20.apache.org%2C38727%2C1713160373549.1713160375337 2024-04-15 05:52:55,414 DEBUG [RS:0;jenkins-hbase20:38727] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46369,DS-acb520b0-1646-4b2b-addf-206ccf8930ba,DISK], DatanodeInfoWithStorage[127.0.0.1:39017,DS-72aec063-4757-46ba-bea4-582cbbb64775,DISK]] 2024-04-15 05:52:55,557 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:55,559 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-04-15 05:52:55,562 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-04-15 05:52:55,584 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-04-15 05:52:55,585 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-15 05:52:55,590 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41783%2C1713160373618.meta, suffix=.meta, logDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/WALs/jenkins-hbase20.apache.org,41783,1713160373618, archiveDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/oldWALs, maxLogs=32 2024-04-15 05:52:55,609 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39017,DS-72aec063-4757-46ba-bea4-582cbbb64775,DISK] 2024-04-15 05:52:55,620 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46369,DS-acb520b0-1646-4b2b-addf-206ccf8930ba,DISK] 2024-04-15 05:52:55,643 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/WALs/jenkins-hbase20.apache.org,41783,1713160373618/jenkins-hbase20.apache.org%2C41783%2C1713160373618.meta.1713160375592.meta 2024-04-15 05:52:55,648 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39017,DS-72aec063-4757-46ba-bea4-582cbbb64775,DISK], DatanodeInfoWithStorage[127.0.0.1:46369,DS-acb520b0-1646-4b2b-addf-206ccf8930ba,DISK]] 2024-04-15 05:52:55,649 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-04-15 05:52:55,651 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-04-15 05:52:55,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-04-15 05:52:55,674 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-04-15 05:52:55,680 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-04-15 05:52:55,680 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:55,681 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-04-15 05:52:55,681 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-04-15 05:52:55,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-04-15 05:52:55,687 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/info 2024-04-15 05:52:55,687 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/info 2024-04-15 05:52:55,688 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-04-15 05:52:55,690 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:55,691 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-04-15 05:52:55,693 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/rep_barrier 2024-04-15 05:52:55,693 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/rep_barrier 2024-04-15 05:52:55,694 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-04-15 05:52:55,698 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:55,699 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-04-15 05:52:55,701 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/table 2024-04-15 05:52:55,701 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/table 2024-04-15 05:52:55,702 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-04-15 05:52:55,703 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:55,711 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740 2024-04-15 05:52:55,714 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740 2024-04-15 05:52:55,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-04-15 05:52:55,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-04-15 05:52:55,730 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70661954, jitterRate=0.05294516682624817}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-04-15 05:52:55,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-04-15 05:52:55,751 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1713160375550 2024-04-15 05:52:55,772 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:meta,,1.1588230740 2024-04-15 05:52:55,773 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-04-15 05:52:55,775 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,41783,1713160373618, state=OPEN 2024-04-15 05:52:55,780 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-04-15 05:52:55,780 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-04-15 05:52:55,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-04-15 05:52:55,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,41783,1713160373618 in 445 msec 2024-04-15 05:52:55,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-04-15 05:52:55,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 665 msec 2024-04-15 05:52:55,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0580 sec 2024-04-15 05:52:55,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1713160375808, completionTime=-1 2024-04-15 05:52:55,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(824): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-04-15 05:52:55,809 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-04-15 05:52:55,888 DEBUG [hconnection-0x2cac894a-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-15 05:52:55,892 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-15 05:52:55,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-04-15 05:52:55,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1713160435911 2024-04-15 05:52:55,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1713160495912 2024-04-15 05:52:55,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 102 msec 2024-04-15 05:52:55,940 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33599,1713160372399-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,940 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33599,1713160372399-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,940 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33599,1713160372399-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,942 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:33599, period=300000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,943 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:55,953 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2024-04-15 05:52:55,963 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-04-15 05:52:55,965 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-04-15 05:52:55,976 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-04-15 05:52:55,980 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-04-15 05:52:55,984 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-15 05:52:56,014 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1 2024-04-15 05:52:56,018 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1 empty. 2024-04-15 05:52:56,019 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1 2024-04-15 05:52:56,019 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-04-15 05:52:56,058 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-04-15 05:52:56,062 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 802641f33321ff154f831a48f5f2c6a1, NAME => 'hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp 2024-04-15 05:52:56,102 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:56,102 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 802641f33321ff154f831a48f5f2c6a1, disabling compactions & flushes 2024-04-15 05:52:56,102 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. 2024-04-15 05:52:56,102 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. 2024-04-15 05:52:56,102 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. after waiting 0 ms 2024-04-15 05:52:56,102 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. 2024-04-15 05:52:56,103 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. 2024-04-15 05:52:56,103 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 802641f33321ff154f831a48f5f2c6a1: 2024-04-15 05:52:56,110 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-04-15 05:52:56,129 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1713160376113"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713160376113"}]},"ts":"1713160376113"} 2024-04-15 05:52:56,171 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-15 05:52:56,173 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-15 05:52:56,178 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160376174"}]},"ts":"1713160376174"} 2024-04-15 05:52:56,184 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-04-15 05:52:56,188 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2024-04-15 05:52:56,191 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-15 05:52:56,191 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-15 05:52:56,191 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-15 05:52:56,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=802641f33321ff154f831a48f5f2c6a1, ASSIGN}] 2024-04-15 05:52:56,196 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=802641f33321ff154f831a48f5f2c6a1, ASSIGN 2024-04-15 05:52:56,198 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=802641f33321ff154f831a48f5f2c6a1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38727,1713160373549; forceNewPlan=false, retain=false 2024-04-15 05:52:56,351 INFO [jenkins-hbase20:33599] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-15 05:52:56,352 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=802641f33321ff154f831a48f5f2c6a1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:56,352 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1713160376352"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1713160376352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713160376352"}]},"ts":"1713160376352"} 2024-04-15 05:52:56,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 802641f33321ff154f831a48f5f2c6a1, server=jenkins-hbase20.apache.org,38727,1713160373549}] 2024-04-15 05:52:56,511 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:56,512 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-04-15 05:52:56,515 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-04-15 05:52:56,522 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. 2024-04-15 05:52:56,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 802641f33321ff154f831a48f5f2c6a1, NAME => 'hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1.', STARTKEY => '', ENDKEY => ''} 2024-04-15 05:52:56,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 802641f33321ff154f831a48f5f2c6a1 2024-04-15 05:52:56,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:56,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 802641f33321ff154f831a48f5f2c6a1 2024-04-15 05:52:56,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 802641f33321ff154f831a48f5f2c6a1 2024-04-15 05:52:56,527 INFO [StoreOpener-802641f33321ff154f831a48f5f2c6a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 802641f33321ff154f831a48f5f2c6a1 2024-04-15 05:52:56,530 DEBUG [StoreOpener-802641f33321ff154f831a48f5f2c6a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1/info 2024-04-15 05:52:56,530 DEBUG [StoreOpener-802641f33321ff154f831a48f5f2c6a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1/info 2024-04-15 05:52:56,531 INFO [StoreOpener-802641f33321ff154f831a48f5f2c6a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 802641f33321ff154f831a48f5f2c6a1 columnFamilyName info 2024-04-15 05:52:56,532 INFO [StoreOpener-802641f33321ff154f831a48f5f2c6a1-1] regionserver.HStore(310): Store=802641f33321ff154f831a48f5f2c6a1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:56,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1 2024-04-15 05:52:56,537 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1 2024-04-15 05:52:56,542 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 802641f33321ff154f831a48f5f2c6a1 2024-04-15 05:52:56,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-15 05:52:56,548 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 802641f33321ff154f831a48f5f2c6a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70945187, jitterRate=0.05716566741466522}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-15 05:52:56,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 802641f33321ff154f831a48f5f2c6a1: 2024-04-15 05:52:56,550 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1., pid=6, masterSystemTime=1713160376511 2024-04-15 05:52:56,557 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. 2024-04-15 05:52:56,558 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. 2024-04-15 05:52:56,560 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=802641f33321ff154f831a48f5f2c6a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:56,560 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1713160376559"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1713160376559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713160376559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713160376559"}]},"ts":"1713160376559"} 2024-04-15 05:52:56,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-04-15 05:52:56,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 802641f33321ff154f831a48f5f2c6a1, server=jenkins-hbase20.apache.org,38727,1713160373549 in 210 msec 2024-04-15 05:52:56,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-04-15 05:52:56,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=802641f33321ff154f831a48f5f2c6a1, ASSIGN in 380 msec 2024-04-15 05:52:56,585 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-15 05:52:56,585 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160376585"}]},"ts":"1713160376585"} 2024-04-15 05:52:56,589 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-04-15 05:52:56,593 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-04-15 05:52:56,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 628 msec 2024-04-15 05:52:56,681 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-04-15 05:52:56,684 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-04-15 05:52:56,684 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-15 05:52:56,704 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-15 05:52:56,706 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-15 05:52:56,721 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-04-15 05:52:56,738 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-15 05:52:56,745 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2024-04-15 05:52:56,755 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-04-15 05:52:56,768 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-15 05:52:56,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2024-04-15 05:52:56,788 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-04-15 05:52:56,790 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-04-15 05:52:56,791 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 3.069sec 2024-04-15 05:52:56,793 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-04-15 05:52:56,794 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-15 05:52:56,796 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-04-15 05:52:56,796 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-04-15 05:52:56,799 INFO [master/jenkins-hbase20:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-04-15 05:52:56,799 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-04-15 05:52:56,802 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-15 05:52:56,805 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b 2024-04-15 05:52:56,806 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b empty. 2024-04-15 05:52:56,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-04-15 05:52:56,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-04-15 05:52:56,808 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b 2024-04-15 05:52:56,808 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-04-15 05:52:56,809 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:56,810 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:56,812 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-04-15 05:52:56,812 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-04-15 05:52:56,814 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33599,1713160372399-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-04-15 05:52:56,814 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33599,1713160372399-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-04-15 05:52:56,830 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-04-15 05:52:56,831 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33599,1713160372399-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-15 05:52:56,833 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-04-15 05:52:56,835 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 368c68480e6a0e6c4e2df632067be36b, NAME => 'hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp 2024-04-15 05:52:56,856 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:56,856 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 368c68480e6a0e6c4e2df632067be36b, disabling compactions & flushes 2024-04-15 05:52:56,856 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. 2024-04-15 05:52:56,856 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. 2024-04-15 05:52:56,856 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. after waiting 0 ms 2024-04-15 05:52:56,856 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. 2024-04-15 05:52:56,856 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. 2024-04-15 05:52:56,856 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 368c68480e6a0e6c4e2df632067be36b: 2024-04-15 05:52:56,860 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-04-15 05:52:56,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1713160376862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713160376862"}]},"ts":"1713160376862"} 2024-04-15 05:52:56,866 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-15 05:52:56,868 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-15 05:52:56,868 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160376868"}]},"ts":"1713160376868"} 2024-04-15 05:52:56,871 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-04-15 05:52:56,876 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2024-04-15 05:52:56,880 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-15 05:52:56,880 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-15 05:52:56,880 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-15 05:52:56,882 DEBUG [Listener at localhost/41827] zookeeper.ReadOnlyZKClient(139): Connect 0x163b61ec to 127.0.0.1:62954 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-15 05:52:56,882 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=368c68480e6a0e6c4e2df632067be36b, ASSIGN}] 2024-04-15 05:52:56,886 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=368c68480e6a0e6c4e2df632067be36b, ASSIGN 2024-04-15 05:52:56,888 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=368c68480e6a0e6c4e2df632067be36b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41783,1713160373618; forceNewPlan=false, retain=false 2024-04-15 05:52:56,890 DEBUG [Listener at localhost/41827] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6efe4426, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-15 05:52:56,906 DEBUG [hconnection-0x699fba78-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-15 05:52:56,920 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-15 05:52:56,928 INFO [Listener at localhost/41827] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,33599,1713160372399 2024-04-15 05:52:56,929 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:52:56,934 DEBUG [Listener at localhost/41827] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-15 05:52:57,037 DEBUG [Listener at localhost/41827] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-15 05:52:57,038 INFO [jenkins-hbase20:33599] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-15 05:52:57,039 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=368c68480e6a0e6c4e2df632067be36b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:57,039 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1713160377039"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1713160377039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713160377039"}]},"ts":"1713160377039"} 2024-04-15 05:52:57,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 368c68480e6a0e6c4e2df632067be36b, server=jenkins-hbase20.apache.org,41783,1713160373618}] 2024-04-15 05:52:57,140 DEBUG [Listener at localhost/41827] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-15 05:52:57,197 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:57,205 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. 2024-04-15 05:52:57,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 368c68480e6a0e6c4e2df632067be36b, NAME => 'hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b.', STARTKEY => '', ENDKEY => ''} 2024-04-15 05:52:57,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 368c68480e6a0e6c4e2df632067be36b 2024-04-15 05:52:57,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:57,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 368c68480e6a0e6c4e2df632067be36b 2024-04-15 05:52:57,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 368c68480e6a0e6c4e2df632067be36b 2024-04-15 05:52:57,208 INFO [StoreOpener-368c68480e6a0e6c4e2df632067be36b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 368c68480e6a0e6c4e2df632067be36b 2024-04-15 05:52:57,211 DEBUG [StoreOpener-368c68480e6a0e6c4e2df632067be36b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/q 2024-04-15 05:52:57,211 DEBUG [StoreOpener-368c68480e6a0e6c4e2df632067be36b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/q 2024-04-15 05:52:57,212 INFO [StoreOpener-368c68480e6a0e6c4e2df632067be36b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 368c68480e6a0e6c4e2df632067be36b columnFamilyName q 2024-04-15 05:52:57,213 INFO [StoreOpener-368c68480e6a0e6c4e2df632067be36b-1] regionserver.HStore(310): Store=368c68480e6a0e6c4e2df632067be36b/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:57,213 INFO [StoreOpener-368c68480e6a0e6c4e2df632067be36b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 368c68480e6a0e6c4e2df632067be36b 2024-04-15 05:52:57,215 DEBUG [StoreOpener-368c68480e6a0e6c4e2df632067be36b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/u 2024-04-15 05:52:57,215 DEBUG [StoreOpener-368c68480e6a0e6c4e2df632067be36b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/u 2024-04-15 05:52:57,216 INFO [StoreOpener-368c68480e6a0e6c4e2df632067be36b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 368c68480e6a0e6c4e2df632067be36b columnFamilyName u 2024-04-15 05:52:57,217 INFO [StoreOpener-368c68480e6a0e6c4e2df632067be36b-1] regionserver.HStore(310): Store=368c68480e6a0e6c4e2df632067be36b/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:57,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b 2024-04-15 05:52:57,220 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b 2024-04-15 05:52:57,223 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-04-15 05:52:57,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 368c68480e6a0e6c4e2df632067be36b 2024-04-15 05:52:57,228 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-15 05:52:57,229 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 368c68480e6a0e6c4e2df632067be36b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73355280, jitterRate=0.0930788516998291}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-04-15 05:52:57,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 368c68480e6a0e6c4e2df632067be36b: 2024-04-15 05:52:57,231 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b., pid=11, masterSystemTime=1713160377197 2024-04-15 05:52:57,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. 2024-04-15 05:52:57,234 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. 2024-04-15 05:52:57,235 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=368c68480e6a0e6c4e2df632067be36b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:57,235 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1713160377235"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1713160377235"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713160377235"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713160377235"}]},"ts":"1713160377235"} 2024-04-15 05:52:57,241 DEBUG [Listener at localhost/41827] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-15 05:52:57,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-04-15 05:52:57,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 368c68480e6a0e6c4e2df632067be36b, server=jenkins-hbase20.apache.org,41783,1713160373618 in 195 msec 2024-04-15 05:52:57,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-04-15 05:52:57,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=368c68480e6a0e6c4e2df632067be36b, ASSIGN in 360 msec 2024-04-15 05:52:57,246 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-15 05:52:57,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160377246"}]},"ts":"1713160377246"} 2024-04-15 05:52:57,248 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-04-15 05:52:57,252 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-04-15 05:52:57,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 458 msec 2024-04-15 05:52:57,354 DEBUG [Listener at localhost/41827] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-04-15 05:52:57,358 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-04-15 05:52:57,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.HMaster$4(2118): Client=jenkins//148.251.75.209 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-15 05:52:57,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-04-15 05:52:57,393 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-04-15 05:52:57,395 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-15 05:52:57,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-04-15 05:52:57,398 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:52:57,400 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39 empty. 2024-04-15 05:52:57,400 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:52:57,401 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-04-15 05:52:57,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-04-15 05:52:57,422 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-04-15 05:52:57,424 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7cf9216c3ec2bd690bd028602f56cb39, NAME => 'TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp 2024-04-15 05:52:57,444 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:57,444 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing 7cf9216c3ec2bd690bd028602f56cb39, disabling compactions & flushes 2024-04-15 05:52:57,444 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. 2024-04-15 05:52:57,444 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. 2024-04-15 05:52:57,444 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. after waiting 0 ms 2024-04-15 05:52:57,444 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. 2024-04-15 05:52:57,444 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. 2024-04-15 05:52:57,445 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for 7cf9216c3ec2bd690bd028602f56cb39: 2024-04-15 05:52:57,449 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-04-15 05:52:57,451 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160377451"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713160377451"}]},"ts":"1713160377451"} 2024-04-15 05:52:57,454 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-15 05:52:57,456 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-15 05:52:57,456 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160377456"}]},"ts":"1713160377456"} 2024-04-15 05:52:57,458 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-04-15 05:52:57,462 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2024-04-15 05:52:57,463 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-15 05:52:57,463 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-15 05:52:57,463 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-15 05:52:57,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=7cf9216c3ec2bd690bd028602f56cb39, ASSIGN}] 2024-04-15 05:52:57,465 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=7cf9216c3ec2bd690bd028602f56cb39, ASSIGN 2024-04-15 05:52:57,467 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=7cf9216c3ec2bd690bd028602f56cb39, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38727,1713160373549; forceNewPlan=false, retain=false 2024-04-15 05:52:57,617 INFO [jenkins-hbase20:33599] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-15 05:52:57,618 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7cf9216c3ec2bd690bd028602f56cb39, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:57,618 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160377618"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1713160377618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713160377618"}]},"ts":"1713160377618"} 2024-04-15 05:52:57,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 7cf9216c3ec2bd690bd028602f56cb39, server=jenkins-hbase20.apache.org,38727,1713160373549}] 2024-04-15 05:52:57,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-04-15 05:52:57,775 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:57,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. 2024-04-15 05:52:57,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7cf9216c3ec2bd690bd028602f56cb39, NAME => 'TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39.', STARTKEY => '', ENDKEY => ''} 2024-04-15 05:52:57,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:52:57,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:57,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:52:57,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:52:57,784 INFO [StoreOpener-7cf9216c3ec2bd690bd028602f56cb39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:52:57,786 DEBUG [StoreOpener-7cf9216c3ec2bd690bd028602f56cb39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/cf 2024-04-15 05:52:57,786 DEBUG [StoreOpener-7cf9216c3ec2bd690bd028602f56cb39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/cf 2024-04-15 05:52:57,787 INFO [StoreOpener-7cf9216c3ec2bd690bd028602f56cb39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7cf9216c3ec2bd690bd028602f56cb39 columnFamilyName cf 2024-04-15 05:52:57,788 INFO [StoreOpener-7cf9216c3ec2bd690bd028602f56cb39-1] regionserver.HStore(310): Store=7cf9216c3ec2bd690bd028602f56cb39/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:57,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:52:57,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:52:57,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:52:57,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-15 05:52:57,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7cf9216c3ec2bd690bd028602f56cb39; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60553652, jitterRate=-0.09768027067184448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-15 05:52:57,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7cf9216c3ec2bd690bd028602f56cb39: 2024-04-15 05:52:57,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39., pid=14, masterSystemTime=1713160377775 2024-04-15 05:52:57,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. 2024-04-15 05:52:57,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. 2024-04-15 05:52:57,821 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7cf9216c3ec2bd690bd028602f56cb39, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:57,822 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160377821"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1713160377821"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713160377821"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713160377821"}]},"ts":"1713160377821"} 2024-04-15 05:52:57,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-04-15 05:52:57,830 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 7cf9216c3ec2bd690bd028602f56cb39, server=jenkins-hbase20.apache.org,38727,1713160373549 in 204 msec 2024-04-15 05:52:57,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-04-15 05:52:57,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=7cf9216c3ec2bd690bd028602f56cb39, ASSIGN in 364 msec 2024-04-15 05:52:57,834 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-15 05:52:57,834 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160377834"}]},"ts":"1713160377834"} 2024-04-15 05:52:57,836 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-04-15 05:52:57,839 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-04-15 05:52:57,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 453 msec 2024-04-15 05:52:58,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-04-15 05:52:58,166 INFO [Listener at localhost/41827] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-04-15 05:52:58,167 DEBUG [Listener at localhost/41827] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-04-15 05:52:58,167 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:52:58,172 INFO [Listener at localhost/41827] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-04-15 05:52:58,173 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:52:58,173 INFO [Listener at localhost/41827] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-04-15 05:52:58,173 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:52:58,187 DEBUG [hconnection-0x699fba78-shared-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-15 05:52:58,190 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-15 05:52:58,195 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-04-15 05:52:58,197 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-04-15 05:52:58,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.HMaster$4(2118): Client=jenkins//148.251.75.209 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-15 05:52:58,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-04-15 05:52:58,203 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-04-15 05:52:58,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-04-15 05:52:58,206 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-15 05:52:58,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-04-15 05:52:58,209 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:52:58,210 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0 empty. 2024-04-15 05:52:58,211 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:52:58,211 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-04-15 05:52:58,246 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-04-15 05:52:58,250 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 588ec1fd2fbf1b0c6e149bb3206e47b0, NAME => 'TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp 2024-04-15 05:52:58,250 DEBUG [hconnection-0x4dd3a8cf-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-15 05:52:58,254 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-04-15 05:52:58,281 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:58,281 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 588ec1fd2fbf1b0c6e149bb3206e47b0, disabling compactions & flushes 2024-04-15 05:52:58,281 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. 2024-04-15 05:52:58,281 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. 2024-04-15 05:52:58,282 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. after waiting 0 ms 2024-04-15 05:52:58,282 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. 2024-04-15 05:52:58,282 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. 2024-04-15 05:52:58,282 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 588ec1fd2fbf1b0c6e149bb3206e47b0: 2024-04-15 05:52:58,287 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-04-15 05:52:58,288 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160378288"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713160378288"}]},"ts":"1713160378288"} 2024-04-15 05:52:58,291 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-15 05:52:58,292 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-15 05:52:58,293 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160378293"}]},"ts":"1713160378293"} 2024-04-15 05:52:58,295 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-04-15 05:52:58,299 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2024-04-15 05:52:58,300 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-15 05:52:58,300 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-15 05:52:58,300 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-15 05:52:58,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=588ec1fd2fbf1b0c6e149bb3206e47b0, ASSIGN}] 2024-04-15 05:52:58,302 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=588ec1fd2fbf1b0c6e149bb3206e47b0, ASSIGN 2024-04-15 05:52:58,304 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=588ec1fd2fbf1b0c6e149bb3206e47b0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41783,1713160373618; forceNewPlan=false, retain=false 2024-04-15 05:52:58,454 INFO [jenkins-hbase20:33599] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-15 05:52:58,455 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=588ec1fd2fbf1b0c6e149bb3206e47b0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:58,456 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160378455"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1713160378455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713160378455"}]},"ts":"1713160378455"} 2024-04-15 05:52:58,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 588ec1fd2fbf1b0c6e149bb3206e47b0, server=jenkins-hbase20.apache.org,41783,1713160373618}] 2024-04-15 05:52:58,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-04-15 05:52:58,612 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:58,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. 2024-04-15 05:52:58,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 588ec1fd2fbf1b0c6e149bb3206e47b0, NAME => 'TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0.', STARTKEY => '', ENDKEY => ''} 2024-04-15 05:52:58,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:52:58,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:58,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:52:58,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:52:58,621 INFO [StoreOpener-588ec1fd2fbf1b0c6e149bb3206e47b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:52:58,623 DEBUG [StoreOpener-588ec1fd2fbf1b0c6e149bb3206e47b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0/cf 2024-04-15 05:52:58,623 DEBUG [StoreOpener-588ec1fd2fbf1b0c6e149bb3206e47b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0/cf 2024-04-15 05:52:58,624 INFO [StoreOpener-588ec1fd2fbf1b0c6e149bb3206e47b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 588ec1fd2fbf1b0c6e149bb3206e47b0 columnFamilyName cf 2024-04-15 05:52:58,625 INFO [StoreOpener-588ec1fd2fbf1b0c6e149bb3206e47b0-1] regionserver.HStore(310): Store=588ec1fd2fbf1b0c6e149bb3206e47b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:58,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:52:58,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:52:58,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:52:58,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-15 05:52:58,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 588ec1fd2fbf1b0c6e149bb3206e47b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61754940, jitterRate=-0.07977968454360962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-15 05:52:58,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 588ec1fd2fbf1b0c6e149bb3206e47b0: 2024-04-15 05:52:58,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0., pid=17, masterSystemTime=1713160378612 2024-04-15 05:52:58,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. 2024-04-15 05:52:58,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. 2024-04-15 05:52:58,649 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=588ec1fd2fbf1b0c6e149bb3206e47b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:52:58,649 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160378648"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1713160378648"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713160378648"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713160378648"}]},"ts":"1713160378648"} 2024-04-15 05:52:58,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-04-15 05:52:58,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 588ec1fd2fbf1b0c6e149bb3206e47b0, server=jenkins-hbase20.apache.org,41783,1713160373618 in 193 msec 2024-04-15 05:52:58,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-04-15 05:52:58,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=588ec1fd2fbf1b0c6e149bb3206e47b0, ASSIGN in 357 msec 2024-04-15 05:52:58,663 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-15 05:52:58,663 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160378663"}]},"ts":"1713160378663"} 2024-04-15 05:52:58,666 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-04-15 05:52:58,669 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-04-15 05:52:58,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 470 msec 2024-04-15 05:52:58,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-04-15 05:52:58,965 INFO [Listener at localhost/41827] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-04-15 05:52:58,965 DEBUG [Listener at localhost/41827] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-04-15 05:52:58,965 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:52:58,972 INFO [Listener at localhost/41827] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-04-15 05:52:58,972 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:52:58,972 INFO [Listener at localhost/41827] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-04-15 05:52:58,973 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:52:58,983 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-04-15 05:52:58,986 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-04-15 05:52:58,987 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$4(2118): Client=jenkins//148.251.75.209 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-15 05:52:58,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-04-15 05:52:58,994 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-04-15 05:52:58,994 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-04-15 05:52:58,996 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-15 05:52:58,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-04-15 05:52:58,999 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:52:59,000 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba empty. 2024-04-15 05:52:59,001 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:52:59,001 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-04-15 05:52:59,029 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-04-15 05:52:59,030 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => c4b4ce145dc1b3255d06d8b16d55eeba, NAME => 'TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp 2024-04-15 05:52:59,049 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:59,049 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing c4b4ce145dc1b3255d06d8b16d55eeba, disabling compactions & flushes 2024-04-15 05:52:59,050 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. 2024-04-15 05:52:59,050 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. 2024-04-15 05:52:59,050 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. after waiting 0 ms 2024-04-15 05:52:59,050 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. 2024-04-15 05:52:59,050 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. 2024-04-15 05:52:59,050 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for c4b4ce145dc1b3255d06d8b16d55eeba: 2024-04-15 05:52:59,054 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-04-15 05:52:59,057 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160379057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713160379057"}]},"ts":"1713160379057"} 2024-04-15 05:52:59,060 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-15 05:52:59,061 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-15 05:52:59,062 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160379061"}]},"ts":"1713160379061"} 2024-04-15 05:52:59,064 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-04-15 05:52:59,069 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2024-04-15 05:52:59,070 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-15 05:52:59,070 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-15 05:52:59,070 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-15 05:52:59,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=c4b4ce145dc1b3255d06d8b16d55eeba, ASSIGN}] 2024-04-15 05:52:59,072 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=c4b4ce145dc1b3255d06d8b16d55eeba, ASSIGN 2024-04-15 05:52:59,073 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=c4b4ce145dc1b3255d06d8b16d55eeba, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38727,1713160373549; forceNewPlan=false, retain=false 2024-04-15 05:52:59,223 INFO [jenkins-hbase20:33599] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-15 05:52:59,224 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=c4b4ce145dc1b3255d06d8b16d55eeba, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:59,224 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160379224"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1713160379224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713160379224"}]},"ts":"1713160379224"} 2024-04-15 05:52:59,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure c4b4ce145dc1b3255d06d8b16d55eeba, server=jenkins-hbase20.apache.org,38727,1713160373549}] 2024-04-15 05:52:59,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-04-15 05:52:59,382 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:59,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. 2024-04-15 05:52:59,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4b4ce145dc1b3255d06d8b16d55eeba, NAME => 'TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba.', STARTKEY => '', ENDKEY => ''} 2024-04-15 05:52:59,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:52:59,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:52:59,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:52:59,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:52:59,396 INFO [StoreOpener-c4b4ce145dc1b3255d06d8b16d55eeba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:52:59,398 DEBUG [StoreOpener-c4b4ce145dc1b3255d06d8b16d55eeba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba/cf 2024-04-15 05:52:59,398 DEBUG [StoreOpener-c4b4ce145dc1b3255d06d8b16d55eeba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba/cf 2024-04-15 05:52:59,398 INFO [StoreOpener-c4b4ce145dc1b3255d06d8b16d55eeba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4b4ce145dc1b3255d06d8b16d55eeba columnFamilyName cf 2024-04-15 05:52:59,399 INFO [StoreOpener-c4b4ce145dc1b3255d06d8b16d55eeba-1] regionserver.HStore(310): Store=c4b4ce145dc1b3255d06d8b16d55eeba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:52:59,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:52:59,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:52:59,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:52:59,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-15 05:52:59,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c4b4ce145dc1b3255d06d8b16d55eeba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71227363, jitterRate=0.06137041747570038}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-15 05:52:59,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c4b4ce145dc1b3255d06d8b16d55eeba: 2024-04-15 05:52:59,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba., pid=20, masterSystemTime=1713160379382 2024-04-15 05:52:59,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. 2024-04-15 05:52:59,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. 2024-04-15 05:52:59,415 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=c4b4ce145dc1b3255d06d8b16d55eeba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:52:59,416 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160379415"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1713160379415"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713160379415"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713160379415"}]},"ts":"1713160379415"} 2024-04-15 05:52:59,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-04-15 05:52:59,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure c4b4ce145dc1b3255d06d8b16d55eeba, server=jenkins-hbase20.apache.org,38727,1713160373549 in 191 msec 2024-04-15 05:52:59,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-04-15 05:52:59,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=c4b4ce145dc1b3255d06d8b16d55eeba, ASSIGN in 350 msec 2024-04-15 05:52:59,425 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-15 05:52:59,425 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160379425"}]},"ts":"1713160379425"} 2024-04-15 05:52:59,427 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-04-15 05:52:59,430 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-04-15 05:52:59,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 442 msec 2024-04-15 05:52:59,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-04-15 05:52:59,752 INFO [Listener at localhost/41827] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-04-15 05:52:59,752 DEBUG [Listener at localhost/41827] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-04-15 05:52:59,752 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:52:59,758 INFO [Listener at localhost/41827] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-04-15 05:52:59,758 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:52:59,758 INFO [Listener at localhost/41827] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-04-15 05:52:59,758 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:52:59,785 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$15(3020): Client=jenkins//148.251.75.209 creating {NAME => 'TestNs'} 2024-04-15 05:52:59,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-04-15 05:52:59,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-04-15 05:52:59,800 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-15 05:52:59,807 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 19 msec 2024-04-15 05:53:00,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-04-15 05:53:00,051 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$4(2118): Client=jenkins//148.251.75.209 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-15 05:53:00,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-04-15 05:53:00,057 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-04-15 05:53:00,057 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-04-15 05:53:00,059 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-15 05:53:00,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-04-15 05:53:00,064 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:53:00,064 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:53:00,065 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b empty. 2024-04-15 05:53:00,065 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524 empty. 2024-04-15 05:53:00,066 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:53:00,066 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:53:00,066 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-04-15 05:53:00,085 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-04-15 05:53:00,108 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => a0fe88d0babce7cb5f5022b81de0845b, NAME => 'TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp 2024-04-15 05:53:00,111 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => e1b03d89859b04f3ed2f6416b6f59524, NAME => 'TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp 2024-04-15 05:53:00,133 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:53:00,133 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing e1b03d89859b04f3ed2f6416b6f59524, disabling compactions & flushes 2024-04-15 05:53:00,133 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. 2024-04-15 05:53:00,133 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. 2024-04-15 05:53:00,134 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. after waiting 0 ms 2024-04-15 05:53:00,134 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. 2024-04-15 05:53:00,134 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. 2024-04-15 05:53:00,134 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:53:00,134 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing a0fe88d0babce7cb5f5022b81de0845b, disabling compactions & flushes 2024-04-15 05:53:00,134 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for e1b03d89859b04f3ed2f6416b6f59524: 2024-04-15 05:53:00,134 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. 2024-04-15 05:53:00,134 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. 2024-04-15 05:53:00,135 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. after waiting 0 ms 2024-04-15 05:53:00,135 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. 2024-04-15 05:53:00,135 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. 2024-04-15 05:53:00,135 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for a0fe88d0babce7cb5f5022b81de0845b: 2024-04-15 05:53:00,139 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-04-15 05:53:00,141 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713160380141"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713160380141"}]},"ts":"1713160380141"} 2024-04-15 05:53:00,141 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713160380141"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713160380141"}]},"ts":"1713160380141"} 2024-04-15 05:53:00,145 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-04-15 05:53:00,146 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-15 05:53:00,147 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160380146"}]},"ts":"1713160380146"} 2024-04-15 05:53:00,149 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-04-15 05:53:00,153 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2024-04-15 05:53:00,154 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-15 05:53:00,154 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-15 05:53:00,154 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-15 05:53:00,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=a0fe88d0babce7cb5f5022b81de0845b, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=e1b03d89859b04f3ed2f6416b6f59524, ASSIGN}] 2024-04-15 05:53:00,157 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=e1b03d89859b04f3ed2f6416b6f59524, ASSIGN 2024-04-15 05:53:00,157 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=a0fe88d0babce7cb5f5022b81de0845b, ASSIGN 2024-04-15 05:53:00,158 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=a0fe88d0babce7cb5f5022b81de0845b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41783,1713160373618; forceNewPlan=false, retain=false 2024-04-15 05:53:00,158 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=e1b03d89859b04f3ed2f6416b6f59524, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38727,1713160373549; forceNewPlan=false, retain=false 2024-04-15 05:53:00,308 INFO [jenkins-hbase20:33599] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-04-15 05:53:00,310 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a0fe88d0babce7cb5f5022b81de0845b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:53:00,310 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e1b03d89859b04f3ed2f6416b6f59524, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:53:00,311 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713160380310"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1713160380310"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713160380310"}]},"ts":"1713160380310"} 2024-04-15 05:53:00,311 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713160380310"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1713160380310"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713160380310"}]},"ts":"1713160380310"} 2024-04-15 05:53:00,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-04-15 05:53:00,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; OpenRegionProcedure a0fe88d0babce7cb5f5022b81de0845b, server=jenkins-hbase20.apache.org,41783,1713160373618}] 2024-04-15 05:53:00,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=24, state=RUNNABLE; OpenRegionProcedure e1b03d89859b04f3ed2f6416b6f59524, server=jenkins-hbase20.apache.org,38727,1713160373549}] 2024-04-15 05:53:00,471 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:53:00,472 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:53:00,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. 2024-04-15 05:53:00,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a0fe88d0babce7cb5f5022b81de0845b, NAME => 'TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b.', STARTKEY => '', ENDKEY => '1'} 2024-04-15 05:53:00,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. 2024-04-15 05:53:00,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e1b03d89859b04f3ed2f6416b6f59524, NAME => 'TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524.', STARTKEY => '1', ENDKEY => ''} 2024-04-15 05:53:00,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:53:00,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:53:00,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:53:00,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:53:00,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-15 05:53:00,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:53:00,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:53:00,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:53:00,483 INFO [StoreOpener-e1b03d89859b04f3ed2f6416b6f59524-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:53:00,483 INFO [StoreOpener-a0fe88d0babce7cb5f5022b81de0845b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:53:00,485 DEBUG [StoreOpener-e1b03d89859b04f3ed2f6416b6f59524-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524/cf 2024-04-15 05:53:00,485 DEBUG [StoreOpener-e1b03d89859b04f3ed2f6416b6f59524-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524/cf 2024-04-15 05:53:00,485 DEBUG [StoreOpener-a0fe88d0babce7cb5f5022b81de0845b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b/cf 2024-04-15 05:53:00,486 DEBUG [StoreOpener-a0fe88d0babce7cb5f5022b81de0845b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b/cf 2024-04-15 05:53:00,486 INFO [StoreOpener-e1b03d89859b04f3ed2f6416b6f59524-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1b03d89859b04f3ed2f6416b6f59524 columnFamilyName cf 2024-04-15 05:53:00,486 INFO [StoreOpener-a0fe88d0babce7cb5f5022b81de0845b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0fe88d0babce7cb5f5022b81de0845b columnFamilyName cf 2024-04-15 05:53:00,487 INFO [StoreOpener-e1b03d89859b04f3ed2f6416b6f59524-1] regionserver.HStore(310): Store=e1b03d89859b04f3ed2f6416b6f59524/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:53:00,488 INFO [StoreOpener-a0fe88d0babce7cb5f5022b81de0845b-1] regionserver.HStore(310): Store=a0fe88d0babce7cb5f5022b81de0845b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-15 05:53:00,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:53:00,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:53:00,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:53:00,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:53:00,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:53:00,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:53:00,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-15 05:53:00,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-15 05:53:00,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e1b03d89859b04f3ed2f6416b6f59524; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61617433, jitterRate=-0.08182869851589203}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-15 05:53:00,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a0fe88d0babce7cb5f5022b81de0845b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70649503, jitterRate=0.05275963246822357}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-15 05:53:00,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e1b03d89859b04f3ed2f6416b6f59524: 2024-04-15 05:53:00,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a0fe88d0babce7cb5f5022b81de0845b: 2024-04-15 05:53:00,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b., pid=25, masterSystemTime=1713160380471 2024-04-15 05:53:00,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524., pid=26, masterSystemTime=1713160380472 2024-04-15 05:53:00,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. 2024-04-15 05:53:00,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. 2024-04-15 05:53:00,504 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a0fe88d0babce7cb5f5022b81de0845b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:53:00,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. 2024-04-15 05:53:00,505 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713160380504"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1713160380504"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713160380504"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713160380504"}]},"ts":"1713160380504"} 2024-04-15 05:53:00,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. 2024-04-15 05:53:00,506 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e1b03d89859b04f3ed2f6416b6f59524, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:53:00,506 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713160380505"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1713160380505"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713160380505"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713160380505"}]},"ts":"1713160380505"} 2024-04-15 05:53:00,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=23 2024-04-15 05:53:00,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=24 2024-04-15 05:53:00,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=23, state=SUCCESS; OpenRegionProcedure a0fe88d0babce7cb5f5022b81de0845b, server=jenkins-hbase20.apache.org,41783,1713160373618 in 191 msec 2024-04-15 05:53:00,514 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=24, state=SUCCESS; OpenRegionProcedure e1b03d89859b04f3ed2f6416b6f59524, server=jenkins-hbase20.apache.org,38727,1713160373549 in 190 msec 2024-04-15 05:53:00,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=a0fe88d0babce7cb5f5022b81de0845b, ASSIGN in 356 msec 2024-04-15 05:53:00,516 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=24, resume processing ppid=22 2024-04-15 05:53:00,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=e1b03d89859b04f3ed2f6416b6f59524, ASSIGN in 358 msec 2024-04-15 05:53:00,517 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-15 05:53:00,518 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160380517"}]},"ts":"1713160380517"} 2024-04-15 05:53:00,520 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-04-15 05:53:00,523 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-04-15 05:53:00,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 472 msec 2024-04-15 05:53:00,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-04-15 05:53:00,818 INFO [Listener at localhost/41827] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-04-15 05:53:00,818 DEBUG [Listener at localhost/41827] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-04-15 05:53:00,818 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:00,827 INFO [Listener at localhost/41827] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-04-15 05:53:00,827 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:00,827 INFO [Listener at localhost/41827] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-04-15 05:53:00,827 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:00,874 INFO [Listener at localhost/41827] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=303, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=179, AvailableMemoryMB=2534 2024-04-15 05:53:01,164 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:01,164 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:01,165 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713163980913 bypass), TestNs=QuotaState(ts=1713163980913 bypass)} 2024-04-15 05:53:01,165 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713163980913 bypass), TestNs:TestTable=QuotaState(ts=1713163980913 bypass), TestQuotaAdmin2=QuotaState(ts=1713163980913 bypass)} 2024-04-15 05:53:01,165 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713163980913 [ TestNs:TestTable ])} 2024-04-15 05:53:01,165 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713163980913 bypass)} 2024-04-15 05:53:01,210 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-04-15 05:53:01,262 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-04-15 05:53:01,263 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-04-15 05:53:01,263 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-04-15 05:53:01,264 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-04-15 05:53:01,264 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-04-15 05:53:01,265 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-04-15 05:53:01,265 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-04-15 05:53:01,415 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:01,416 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:01,416 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713163980913 bypass), TestNs=QuotaState(ts=1713163980913 bypass)} 2024-04-15 05:53:01,416 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713163980913 bypass), TestQuotaAdmin1=QuotaState(ts=1713163980913 bypass)} 2024-04-15 05:53:01,416 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713163980913 [ TestNs:TestTable ])} 2024-04-15 05:53:01,416 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713163980913 bypass)} 2024-04-15 05:53:01,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:01,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 148.251.75.209:32834 deadline: 1713160391440, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:01,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:01,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 148.251.75.209:32834 deadline: 1713160391440, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:02,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:02,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 148.251.75.209:32834 deadline: 1713160391441, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:02,571 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-04-15 05:53:02,572 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-04-15 05:53:02,573 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-04-15 05:53:02,573 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-04-15 05:53:02,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:02,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 148.251.75.209:32834 deadline: 1713160391440, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:04,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:04,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 148.251.75.209:32834 deadline: 1713160391440, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:06,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:06,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 148.251.75.209:32834 deadline: 1713160391440, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:06,764 ERROR [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10333: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524., hostname=jenkins-hbase20.apache.org,38727,1713160373549, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-15 05:53:06,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:06,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 148.251.75.209:32834 deadline: 1713160396767, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:07,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:07,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 148.251.75.209:32834 deadline: 1713160396767, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:07,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:07,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 148.251.75.209:32834 deadline: 1713160396767, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:08,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:08,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 148.251.75.209:32834 deadline: 1713160396767, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:09,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:09,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 148.251.75.209:32834 deadline: 1713160396767, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:12,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:12,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 148.251.75.209:32834 deadline: 1713160396768, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:12,069 ERROR [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10328: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524., hostname=jenkins-hbase20.apache.org,38727,1713160373549, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-15 05:53:12,333 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:12,334 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:12,334 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713167580913 bypass), TestNs=QuotaState(ts=1713167580913 bypass)} 2024-04-15 05:53:12,334 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713167580913 bypass), TestNs:TestTable=QuotaState(ts=1713167580913 bypass), TestQuotaAdmin2=QuotaState(ts=1713167580913 bypass)} 2024-04-15 05:53:12,334 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713167580913 bypass)} 2024-04-15 05:53:12,334 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713167580913 bypass)} 2024-04-15 05:53:12,584 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:12,585 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:12,585 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713167580913 bypass), TestNs=QuotaState(ts=1713167580913 bypass)} 2024-04-15 05:53:12,585 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713167580913 bypass), TestQuotaAdmin1=QuotaState(ts=1713167580913 bypass)} 2024-04-15 05:53:12,585 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713167580913 bypass)} 2024-04-15 05:53:12,585 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713167580913 bypass)} 2024-04-15 05:53:12,604 INFO [Listener at localhost/41827] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=289 (was 303), OpenFileDescriptor=601 (was 632), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=298 (was 288) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=2509 (was 2534) 2024-04-15 05:53:12,616 INFO [Listener at localhost/41827] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=289, OpenFileDescriptor=601, MaxFileDescriptor=60000, SystemLoadAverage=298, ProcessCount=179, AvailableMemoryMB=2509 2024-04-15 05:53:12,881 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:12,881 INFO [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-15 05:53:13,131 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:13,133 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713171181013 bypass), TestNs=QuotaState(ts=1713171181013 bypass)} 2024-04-15 05:53:13,135 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713171181013 bypass), TestNs:TestTable=QuotaState(ts=1713171181013 bypass), TestQuotaAdmin2=QuotaState(ts=1713171181013 bypass)} 2024-04-15 05:53:13,135 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713171181013 [ default ])} 2024-04-15 05:53:13,136 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713171181013 bypass)} 2024-04-15 05:53:13,386 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:13,386 INFO [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-15 05:53:13,637 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:13,638 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713171181113 bypass), TestNs=QuotaState(ts=1713171181113 bypass)} 2024-04-15 05:53:13,640 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713171181113 bypass), TestQuotaAdmin1=QuotaState(ts=1713171181113 bypass)} 2024-04-15 05:53:13,640 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713171181113 [ default ])} 2024-04-15 05:53:13,640 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713171181113 bypass)} 2024-04-15 05:53:13,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:13,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 148.251.75.209:32834 deadline: 1713160403652, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:13,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:13,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 148.251.75.209:32834 deadline: 1713160403652, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:14,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:14,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 148.251.75.209:32834 deadline: 1713160403652, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:15,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:15,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160403651, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:16,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:16,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160403652, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:18,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:18,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160403651, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:18,953 ERROR [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10304: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39., hostname=jenkins-hbase20.apache.org,38727,1713160373549, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-15 05:53:18,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:18,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160408970, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:19,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:19,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160408970, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:19,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:19,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160408971, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:20,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:20,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160408971, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:21,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:21,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160408971, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:24,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:24,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160408971, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:24,267 ERROR [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10338: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39., hostname=jenkins-hbase20.apache.org,38727,1713160373549, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-15 05:53:24,527 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:24,527 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:24,527 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713174781113 bypass), TestNs=QuotaState(ts=1713174781113 bypass)} 2024-04-15 05:53:24,527 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713174781113 bypass), TestNs:TestTable=QuotaState(ts=1713174781113 bypass), TestQuotaAdmin2=QuotaState(ts=1713174781113 bypass)} 2024-04-15 05:53:24,527 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713174781113 bypass)} 2024-04-15 05:53:24,528 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713174781113 bypass)} 2024-04-15 05:53:24,778 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:24,778 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:24,779 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713174781113 bypass), TestNs=QuotaState(ts=1713174781113 bypass)} 2024-04-15 05:53:24,779 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713174781113 bypass), TestQuotaAdmin1=QuotaState(ts=1713174781113 bypass)} 2024-04-15 05:53:24,779 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713174781113 bypass)} 2024-04-15 05:53:24,779 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713174781113 bypass)} 2024-04-15 05:53:24,794 INFO [Listener at localhost/41827] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=289 (was 289), OpenFileDescriptor=597 (was 601), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=281 (was 298), ProcessCount=179 (was 179), AvailableMemoryMB=2277 (was 2509) 2024-04-15 05:53:24,813 INFO [Listener at localhost/41827] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=289, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=179, AvailableMemoryMB=2276 2024-04-15 05:53:25,083 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:25,083 INFO [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-15 05:53:25,334 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:25,335 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713178381213 bypass), TestNs=QuotaState(ts=1713178381213 bypass)} 2024-04-15 05:53:25,336 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713178381213 bypass), TestNs:TestTable=QuotaState(ts=1713178381213 bypass), TestQuotaAdmin2=QuotaState(ts=1713178381213 bypass)} 2024-04-15 05:53:25,336 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713178381213 global-limiter)} 2024-04-15 05:53:25,337 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713178381213 bypass)} 2024-04-15 05:53:25,587 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:25,587 INFO [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-15 05:53:25,838 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:25,839 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713178381313 bypass), TestNs=QuotaState(ts=1713178381313 bypass)} 2024-04-15 05:53:25,839 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713178381313 bypass), TestQuotaAdmin1=QuotaState(ts=1713178381313 bypass)} 2024-04-15 05:53:25,839 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713178381313 global-limiter)} 2024-04-15 05:53:25,840 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713178381313 bypass)} 2024-04-15 05:53:25,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:25,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160415857, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:26,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:26,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160415858, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:26,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:26,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160415858, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:27,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:27,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160415857, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:28,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:28,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160415858, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:31,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:31,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160415858, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:31,164 ERROR [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10327: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39., hostname=jenkins-hbase20.apache.org,38727,1713160373549, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-15 05:53:31,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-15 05:53:31,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160421171, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-15 05:53:31,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-15 05:53:31,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160421172, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-15 05:53:31,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-15 05:53:31,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160421172, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-15 05:53:32,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-15 05:53:32,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160421172, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-15 05:53:33,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-15 05:53:33,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160421172, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-15 05:53:36,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-15 05:53:36,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160421172, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-15 05:53:36,459 ERROR [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10300: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39., hostname=jenkins-hbase20.apache.org,38727,1713160373549, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-15 05:53:36,722 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:36,723 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:36,723 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713181981313 bypass), TestNs=QuotaState(ts=1713181981313 bypass)} 2024-04-15 05:53:36,723 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713181981313 bypass), TestNs:TestTable=QuotaState(ts=1713181981313 bypass), TestQuotaAdmin2=QuotaState(ts=1713181981313 bypass)} 2024-04-15 05:53:36,723 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713181981313 bypass)} 2024-04-15 05:53:36,723 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713181981313 bypass)} 2024-04-15 05:53:36,974 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:36,974 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:36,974 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713181981313 bypass), TestNs=QuotaState(ts=1713181981313 bypass)} 2024-04-15 05:53:36,974 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713181981313 bypass), TestQuotaAdmin1=QuotaState(ts=1713181981313 bypass)} 2024-04-15 05:53:36,974 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713181981313 bypass)} 2024-04-15 05:53:36,974 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713181981313 bypass)} 2024-04-15 05:53:36,990 INFO [Listener at localhost/41827] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=280 (was 289), OpenFileDescriptor=595 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 281), ProcessCount=179 (was 179), AvailableMemoryMB=2172 (was 2276) 2024-04-15 05:53:37,007 INFO [Listener at localhost/41827] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=280, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=179, AvailableMemoryMB=2171 2024-04-15 05:53:37,265 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:37,266 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:37,268 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713185581313 bypass), TestNs=QuotaState(ts=1713185581313 bypass)} 2024-04-15 05:53:37,271 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713185581313 bypass), TestNs:TestTable=QuotaState(ts=1713185581313 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1713185581313 bypass)} 2024-04-15 05:53:37,271 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-15 05:53:37,273 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713185581313 bypass)} 2024-04-15 05:53:37,524 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:37,524 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:37,524 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713185581313 bypass), TestNs=QuotaState(ts=1713185581313 bypass)} 2024-04-15 05:53:37,525 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713185581313 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1713185581313 bypass)} 2024-04-15 05:53:37,526 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-15 05:53:37,526 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713185581313 bypass)} 2024-04-15 05:53:37,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:37,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 148.251.75.209:32834 deadline: 1713160427549, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:37,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:37,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 148.251.75.209:32834 deadline: 1713160427550, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:38,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:38,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 148.251.75.209:32834 deadline: 1713160427549, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:39,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:39,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 148.251.75.209:32834 deadline: 1713160427550, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:40,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:40,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 148.251.75.209:32834 deadline: 1713160427551, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:42,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:42,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 148.251.75.209:32834 deadline: 1713160427550, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:42,870 ERROR [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10340: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524., hostname=jenkins-hbase20.apache.org,38727,1713160373549, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-15 05:53:42,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:42,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 148.251.75.209:32834 deadline: 1713160432871, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:43,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:43,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 148.251.75.209:32834 deadline: 1713160432872, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:43,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:43,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 148.251.75.209:32834 deadline: 1713160432872, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:44,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:44,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 148.251.75.209:32834 deadline: 1713160432872, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:45,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:45,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 148.251.75.209:32834 deadline: 1713160432871, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:48,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:48,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 148.251.75.209:32834 deadline: 1713160432872, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-15 05:53:48,156 ERROR [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10319: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524., hostname=jenkins-hbase20.apache.org,38727,1713160373549, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-15 05:53:48,416 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:48,416 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:48,416 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713189181313 bypass), TestNs=QuotaState(ts=1713189181313 bypass)} 2024-04-15 05:53:48,416 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713189181313 bypass), TestNs:TestTable=QuotaState(ts=1713189181313 bypass), TestQuotaAdmin2=QuotaState(ts=1713189181313 bypass)} 2024-04-15 05:53:48,417 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713189181313 bypass)} 2024-04-15 05:53:48,417 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713189181313 bypass)} 2024-04-15 05:53:48,667 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:48,667 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:48,668 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713189181313 bypass), TestNs=QuotaState(ts=1713189181313 bypass)} 2024-04-15 05:53:48,668 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713189181313 bypass), TestQuotaAdmin1=QuotaState(ts=1713189181313 bypass)} 2024-04-15 05:53:48,668 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-15 05:53:48,668 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713189181313 bypass)} 2024-04-15 05:53:48,684 INFO [Listener at localhost/41827] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=279 (was 280), OpenFileDescriptor=595 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=222 (was 254), ProcessCount=179 (was 179), AvailableMemoryMB=2011 (was 2171) 2024-04-15 05:53:48,696 INFO [Listener at localhost/41827] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=279, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=222, ProcessCount=179, AvailableMemoryMB=2011 2024-04-15 05:53:48,961 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:48,962 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:48,964 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713192781313 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1713192781313 bypass)} 2024-04-15 05:53:48,965 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713192781313 bypass), TestNs:TestTable=QuotaState(ts=1713192781313 bypass), TestQuotaAdmin2=QuotaState(ts=1713192781313 bypass)} 2024-04-15 05:53:48,965 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-15 05:53:48,965 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713192781313 bypass)} 2024-04-15 05:53:49,216 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:53:49,216 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:53:49,217 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713192781313 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1713192781313 bypass)} 2024-04-15 05:53:49,217 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713192781313 bypass), TestQuotaAdmin1=QuotaState(ts=1713192781313 bypass)} 2024-04-15 05:53:49,217 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-15 05:53:49,218 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713192781313 bypass)} 2024-04-15 05:53:49,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:49,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160439237, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:49,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:49,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160439236, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:50,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:50,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160439237, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:50,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:50,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160439236, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:52,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:52,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160439237, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:54,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:54,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 148.251.75.209:32834 deadline: 1713160439237, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-15 05:53:54,552 ERROR [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10350: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39., hostname=jenkins-hbase20.apache.org,38727,1713160373549, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-15 05:53:54,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:54,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160444561, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:54,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:54,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160444561, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:55,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:55,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160444561, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:56,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:56,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160444560, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:57,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:57,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160444561, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:59,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:59,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 148.251.75.209:32834 deadline: 1713160444561, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-15 05:53:59,864 ERROR [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10332: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39., hostname=jenkins-hbase20.apache.org,38727,1713160373549, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-15 05:54:00,124 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:54:00,124 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:54:00,125 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713196381313 bypass), TestNs=QuotaState(ts=1713196381313 bypass)} 2024-04-15 05:54:00,125 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713196381313 bypass), TestNs:TestTable=QuotaState(ts=1713196381313 bypass), TestQuotaAdmin2=QuotaState(ts=1713196381313 bypass)} 2024-04-15 05:54:00,125 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713196381313 bypass)} 2024-04-15 05:54:00,125 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713196381313 bypass)} 2024-04-15 05:54:00,375 INFO [Listener at localhost/41827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-15 05:54:00,376 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-15 05:54:00,376 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713196381313 bypass), TestNs=QuotaState(ts=1713196381313 bypass)} 2024-04-15 05:54:00,376 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713196381313 bypass), TestQuotaAdmin1=QuotaState(ts=1713196381313 bypass)} 2024-04-15 05:54:00,376 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-15 05:54:00,376 DEBUG [Listener at localhost/41827] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713196381313 bypass)} 2024-04-15 05:54:00,396 INFO [Listener at localhost/41827] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=266 (was 279), OpenFileDescriptor=583 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 222), ProcessCount=179 (was 179), AvailableMemoryMB=2004 (was 2011) 2024-04-15 05:54:00,399 INFO [Listener at localhost/41827] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-04-15 05:54:00,405 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$11(2424): Client=jenkins//148.251.75.209 disable TestQuotaAdmin0 2024-04-15 05:54:00,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-04-15 05:54:00,417 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160440417"}]},"ts":"1713160440417"} 2024-04-15 05:54:00,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-04-15 05:54:00,419 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-04-15 05:54:00,421 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-04-15 05:54:00,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=7cf9216c3ec2bd690bd028602f56cb39, UNASSIGN}] 2024-04-15 05:54:00,424 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=7cf9216c3ec2bd690bd028602f56cb39, UNASSIGN 2024-04-15 05:54:00,425 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7cf9216c3ec2bd690bd028602f56cb39, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:54:00,425 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160440425"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1713160440425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713160440425"}]},"ts":"1713160440425"} 2024-04-15 05:54:00,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 7cf9216c3ec2bd690bd028602f56cb39, server=jenkins-hbase20.apache.org,38727,1713160373549}] 2024-04-15 05:54:00,473 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase20.apache.org,38727,1713160373549, timeout=1713160440583, delay=110, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 7cf9216c3ec2bd690bd028602f56cb39, server=jenkins-hbase20.apache.org,38727,1713160373549]] 2024-04-15 05:54:00,588 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:54:00,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:54:00,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7cf9216c3ec2bd690bd028602f56cb39, disabling compactions & flushes 2024-04-15 05:54:00,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. 2024-04-15 05:54:00,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. 2024-04-15 05:54:00,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. after waiting 0 ms 2024-04-15 05:54:00,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. 2024-04-15 05:54:00,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 7cf9216c3ec2bd690bd028602f56cb39 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-04-15 05:54:00,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/.tmp/cf/c58b089ad1594fd784d015acaf9fe6f0 2024-04-15 05:54:00,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-04-15 05:54:00,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/.tmp/cf/c58b089ad1594fd784d015acaf9fe6f0 as hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/cf/c58b089ad1594fd784d015acaf9fe6f0 2024-04-15 05:54:00,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/cf/c58b089ad1594fd784d015acaf9fe6f0, entries=6, sequenceid=21, filesize=4.7 K 2024-04-15 05:54:00,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for 7cf9216c3ec2bd690bd028602f56cb39 in 133ms, sequenceid=21, compaction requested=false 2024-04-15 05:54:00,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-04-15 05:54:00,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39. 2024-04-15 05:54:00,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7cf9216c3ec2bd690bd028602f56cb39: 2024-04-15 05:54:00,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:54:00,745 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7cf9216c3ec2bd690bd028602f56cb39, regionState=CLOSED 2024-04-15 05:54:00,745 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160440745"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713160440745"}]},"ts":"1713160440745"} 2024-04-15 05:54:00,748 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-04-15 05:54:00,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure 7cf9216c3ec2bd690bd028602f56cb39, server=jenkins-hbase20.apache.org,38727,1713160373549 in 320 msec 2024-04-15 05:54:00,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-04-15 05:54:00,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=7cf9216c3ec2bd690bd028602f56cb39, UNASSIGN in 325 msec 2024-04-15 05:54:00,752 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160440751"}]},"ts":"1713160440751"} 2024-04-15 05:54:00,753 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-04-15 05:54:00,755 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-04-15 05:54:00,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 349 msec 2024-04-15 05:54:01,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-04-15 05:54:01,172 INFO [Listener at localhost/41827] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-04-15 05:54:01,181 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$5(2234): Client=jenkins//148.251.75.209 delete TestQuotaAdmin0 2024-04-15 05:54:01,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-15 05:54:01,192 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-15 05:54:01,195 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-15 05:54:01,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-04-15 05:54:01,204 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:54:01,208 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/cf, FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/recovered.edits] 2024-04-15 05:54:01,220 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/cf/c58b089ad1594fd784d015acaf9fe6f0 to hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/archive/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/cf/c58b089ad1594fd784d015acaf9fe6f0 2024-04-15 05:54:01,227 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/recovered.edits/24.seqid to hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/archive/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39/recovered.edits/24.seqid 2024-04-15 05:54:01,229 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin0/7cf9216c3ec2bd690bd028602f56cb39 2024-04-15 05:54:01,229 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-04-15 05:54:01,234 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-15 05:54:01,254 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-04-15 05:54:01,257 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-04-15 05:54:01,258 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-15 05:54:01,258 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-04-15 05:54:01,259 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713160441259"}]},"ts":"9223372036854775807"} 2024-04-15 05:54:01,261 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-04-15 05:54:01,261 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7cf9216c3ec2bd690bd028602f56cb39, NAME => 'TestQuotaAdmin0,,1713160377382.7cf9216c3ec2bd690bd028602f56cb39.', STARTKEY => '', ENDKEY => ''}] 2024-04-15 05:54:01,261 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-04-15 05:54:01,261 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713160441261"}]},"ts":"9223372036854775807"} 2024-04-15 05:54:01,263 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-04-15 05:54:01,265 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-15 05:54:01,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 83 msec 2024-04-15 05:54:01,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-04-15 05:54:01,454 INFO [Listener at localhost/41827] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-04-15 05:54:01,455 INFO [Listener at localhost/41827] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-04-15 05:54:01,456 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$11(2424): Client=jenkins//148.251.75.209 disable TestQuotaAdmin1 2024-04-15 05:54:01,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-04-15 05:54:01,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-04-15 05:54:01,465 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160441465"}]},"ts":"1713160441465"} 2024-04-15 05:54:01,468 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-04-15 05:54:01,470 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-04-15 05:54:01,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=588ec1fd2fbf1b0c6e149bb3206e47b0, UNASSIGN}] 2024-04-15 05:54:01,472 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=588ec1fd2fbf1b0c6e149bb3206e47b0, UNASSIGN 2024-04-15 05:54:01,473 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=588ec1fd2fbf1b0c6e149bb3206e47b0, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:54:01,473 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160441473"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1713160441473"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713160441473"}]},"ts":"1713160441473"} 2024-04-15 05:54:01,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 588ec1fd2fbf1b0c6e149bb3206e47b0, server=jenkins-hbase20.apache.org,41783,1713160373618}] 2024-04-15 05:54:01,628 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:54:01,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:54:01,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 588ec1fd2fbf1b0c6e149bb3206e47b0, disabling compactions & flushes 2024-04-15 05:54:01,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. 2024-04-15 05:54:01,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. 2024-04-15 05:54:01,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. after waiting 0 ms 2024-04-15 05:54:01,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. 2024-04-15 05:54:01,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-15 05:54:01,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0. 2024-04-15 05:54:01,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 588ec1fd2fbf1b0c6e149bb3206e47b0: 2024-04-15 05:54:01,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:54:01,652 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=588ec1fd2fbf1b0c6e149bb3206e47b0, regionState=CLOSED 2024-04-15 05:54:01,652 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160441652"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713160441652"}]},"ts":"1713160441652"} 2024-04-15 05:54:01,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-04-15 05:54:01,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 588ec1fd2fbf1b0c6e149bb3206e47b0, server=jenkins-hbase20.apache.org,41783,1713160373618 in 179 msec 2024-04-15 05:54:01,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-04-15 05:54:01,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=588ec1fd2fbf1b0c6e149bb3206e47b0, UNASSIGN in 187 msec 2024-04-15 05:54:01,663 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160441663"}]},"ts":"1713160441663"} 2024-04-15 05:54:01,665 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-04-15 05:54:01,667 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-04-15 05:54:01,670 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 211 msec 2024-04-15 05:54:01,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-04-15 05:54:01,716 INFO [Listener at localhost/41827] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-04-15 05:54:01,717 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$5(2234): Client=jenkins//148.251.75.209 delete TestQuotaAdmin1 2024-04-15 05:54:01,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-15 05:54:01,720 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-15 05:54:01,721 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-15 05:54:01,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-04-15 05:54:01,727 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:54:01,730 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0/cf, FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0/recovered.edits] 2024-04-15 05:54:01,739 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0/recovered.edits/4.seqid to hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/archive/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0/recovered.edits/4.seqid 2024-04-15 05:54:01,739 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin1/588ec1fd2fbf1b0c6e149bb3206e47b0 2024-04-15 05:54:01,739 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-04-15 05:54:01,744 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-15 05:54:01,746 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-04-15 05:54:01,748 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-04-15 05:54:01,750 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-15 05:54:01,750 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-04-15 05:54:01,750 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713160441750"}]},"ts":"9223372036854775807"} 2024-04-15 05:54:01,752 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-04-15 05:54:01,752 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 588ec1fd2fbf1b0c6e149bb3206e47b0, NAME => 'TestQuotaAdmin1,,1713160378198.588ec1fd2fbf1b0c6e149bb3206e47b0.', STARTKEY => '', ENDKEY => ''}] 2024-04-15 05:54:01,753 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-04-15 05:54:01,753 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713160441753"}]},"ts":"9223372036854775807"} 2024-04-15 05:54:01,755 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-04-15 05:54:01,757 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-15 05:54:01,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 40 msec 2024-04-15 05:54:01,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-04-15 05:54:01,975 INFO [Listener at localhost/41827] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-04-15 05:54:01,976 INFO [Listener at localhost/41827] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-04-15 05:54:01,976 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$11(2424): Client=jenkins//148.251.75.209 disable TestQuotaAdmin2 2024-04-15 05:54:01,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-04-15 05:54:01,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-04-15 05:54:01,984 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160441984"}]},"ts":"1713160441984"} 2024-04-15 05:54:01,987 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-04-15 05:54:01,989 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-04-15 05:54:01,990 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=c4b4ce145dc1b3255d06d8b16d55eeba, UNASSIGN}] 2024-04-15 05:54:01,991 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=c4b4ce145dc1b3255d06d8b16d55eeba, UNASSIGN 2024-04-15 05:54:01,992 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c4b4ce145dc1b3255d06d8b16d55eeba, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:54:01,992 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160441991"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1713160441991"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713160441991"}]},"ts":"1713160441991"} 2024-04-15 05:54:01,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure c4b4ce145dc1b3255d06d8b16d55eeba, server=jenkins-hbase20.apache.org,38727,1713160373549}] 2024-04-15 05:54:02,146 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:54:02,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:54:02,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c4b4ce145dc1b3255d06d8b16d55eeba, disabling compactions & flushes 2024-04-15 05:54:02,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. 2024-04-15 05:54:02,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. 2024-04-15 05:54:02,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. after waiting 0 ms 2024-04-15 05:54:02,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. 2024-04-15 05:54:02,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-15 05:54:02,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba. 2024-04-15 05:54:02,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c4b4ce145dc1b3255d06d8b16d55eeba: 2024-04-15 05:54:02,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:54:02,162 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c4b4ce145dc1b3255d06d8b16d55eeba, regionState=CLOSED 2024-04-15 05:54:02,162 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713160442162"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713160442162"}]},"ts":"1713160442162"} 2024-04-15 05:54:02,166 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-04-15 05:54:02,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure c4b4ce145dc1b3255d06d8b16d55eeba, server=jenkins-hbase20.apache.org,38727,1713160373549 in 171 msec 2024-04-15 05:54:02,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-04-15 05:54:02,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=c4b4ce145dc1b3255d06d8b16d55eeba, UNASSIGN in 176 msec 2024-04-15 05:54:02,169 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160442169"}]},"ts":"1713160442169"} 2024-04-15 05:54:02,170 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-04-15 05:54:02,172 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-04-15 05:54:02,175 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 196 msec 2024-04-15 05:54:02,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-04-15 05:54:02,235 INFO [Listener at localhost/41827] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-04-15 05:54:02,236 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$5(2234): Client=jenkins//148.251.75.209 delete TestQuotaAdmin2 2024-04-15 05:54:02,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-15 05:54:02,240 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-15 05:54:02,241 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-15 05:54:02,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-04-15 05:54:02,247 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:54:02,251 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba/cf, FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba/recovered.edits] 2024-04-15 05:54:02,260 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba/recovered.edits/4.seqid to hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/archive/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba/recovered.edits/4.seqid 2024-04-15 05:54:02,261 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/default/TestQuotaAdmin2/c4b4ce145dc1b3255d06d8b16d55eeba 2024-04-15 05:54:02,261 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-04-15 05:54:02,264 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-15 05:54:02,266 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-04-15 05:54:02,268 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-04-15 05:54:02,269 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-15 05:54:02,269 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-04-15 05:54:02,269 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713160442269"}]},"ts":"9223372036854775807"} 2024-04-15 05:54:02,271 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-04-15 05:54:02,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c4b4ce145dc1b3255d06d8b16d55eeba, NAME => 'TestQuotaAdmin2,,1713160378987.c4b4ce145dc1b3255d06d8b16d55eeba.', STARTKEY => '', ENDKEY => ''}] 2024-04-15 05:54:02,271 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-04-15 05:54:02,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713160442271"}]},"ts":"9223372036854775807"} 2024-04-15 05:54:02,273 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-04-15 05:54:02,275 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-15 05:54:02,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 39 msec 2024-04-15 05:54:02,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-04-15 05:54:02,497 INFO [Listener at localhost/41827] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-04-15 05:54:02,499 INFO [Listener at localhost/41827] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-04-15 05:54:02,500 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$11(2424): Client=jenkins//148.251.75.209 disable TestNs:TestTable 2024-04-15 05:54:02,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-04-15 05:54:02,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-04-15 05:54:02,511 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160442511"}]},"ts":"1713160442511"} 2024-04-15 05:54:02,513 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-04-15 05:54:02,516 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-04-15 05:54:02,517 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=a0fe88d0babce7cb5f5022b81de0845b, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=e1b03d89859b04f3ed2f6416b6f59524, UNASSIGN}] 2024-04-15 05:54:02,518 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=e1b03d89859b04f3ed2f6416b6f59524, UNASSIGN 2024-04-15 05:54:02,518 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=a0fe88d0babce7cb5f5022b81de0845b, UNASSIGN 2024-04-15 05:54:02,519 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=e1b03d89859b04f3ed2f6416b6f59524, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:54:02,519 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a0fe88d0babce7cb5f5022b81de0845b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:54:02,520 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713160442519"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1713160442519"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713160442519"}]},"ts":"1713160442519"} 2024-04-15 05:54:02,520 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713160442519"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1713160442519"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713160442519"}]},"ts":"1713160442519"} 2024-04-15 05:54:02,522 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=41, state=RUNNABLE; CloseRegionProcedure e1b03d89859b04f3ed2f6416b6f59524, server=jenkins-hbase20.apache.org,38727,1713160373549}] 2024-04-15 05:54:02,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=40, state=RUNNABLE; CloseRegionProcedure a0fe88d0babce7cb5f5022b81de0845b, server=jenkins-hbase20.apache.org,41783,1713160373618}] 2024-04-15 05:54:02,674 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:54:02,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:54:02,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e1b03d89859b04f3ed2f6416b6f59524, disabling compactions & flushes 2024-04-15 05:54:02,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. 2024-04-15 05:54:02,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. 2024-04-15 05:54:02,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. after waiting 0 ms 2024-04-15 05:54:02,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. 2024-04-15 05:54:02,677 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(718): New admin connection to jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:54:02,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:54:02,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a0fe88d0babce7cb5f5022b81de0845b, disabling compactions & flushes 2024-04-15 05:54:02,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. 2024-04-15 05:54:02,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. 2024-04-15 05:54:02,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. after waiting 0 ms 2024-04-15 05:54:02,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. 2024-04-15 05:54:02,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-15 05:54:02,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524. 2024-04-15 05:54:02,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e1b03d89859b04f3ed2f6416b6f59524: 2024-04-15 05:54:02,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-15 05:54:02,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b. 2024-04-15 05:54:02,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a0fe88d0babce7cb5f5022b81de0845b: 2024-04-15 05:54:02,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:54:02,690 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=e1b03d89859b04f3ed2f6416b6f59524, regionState=CLOSED 2024-04-15 05:54:02,691 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713160442690"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713160442690"}]},"ts":"1713160442690"} 2024-04-15 05:54:02,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:54:02,691 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a0fe88d0babce7cb5f5022b81de0845b, regionState=CLOSED 2024-04-15 05:54:02,691 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713160442691"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713160442691"}]},"ts":"1713160442691"} 2024-04-15 05:54:02,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=41 2024-04-15 05:54:02,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=40 2024-04-15 05:54:02,695 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=41, state=SUCCESS; CloseRegionProcedure e1b03d89859b04f3ed2f6416b6f59524, server=jenkins-hbase20.apache.org,38727,1713160373549 in 170 msec 2024-04-15 05:54:02,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=40, state=SUCCESS; CloseRegionProcedure a0fe88d0babce7cb5f5022b81de0845b, server=jenkins-hbase20.apache.org,41783,1713160373618 in 170 msec 2024-04-15 05:54:02,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=e1b03d89859b04f3ed2f6416b6f59524, UNASSIGN in 177 msec 2024-04-15 05:54:02,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2024-04-15 05:54:02,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=a0fe88d0babce7cb5f5022b81de0845b, UNASSIGN in 178 msec 2024-04-15 05:54:02,697 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713160442697"}]},"ts":"1713160442697"} 2024-04-15 05:54:02,699 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-04-15 05:54:02,700 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-04-15 05:54:02,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 201 msec 2024-04-15 05:54:02,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-04-15 05:54:02,764 INFO [Listener at localhost/41827] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-04-15 05:54:02,766 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$5(2234): Client=jenkins//148.251.75.209 delete TestNs:TestTable 2024-04-15 05:54:02,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-04-15 05:54:02,770 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-15 05:54:02,770 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-15 05:54:02,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-04-15 05:54:02,777 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:54:02,780 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:54:02,782 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b/cf, FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b/recovered.edits] 2024-04-15 05:54:02,782 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524/cf, FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524/recovered.edits] 2024-04-15 05:54:02,789 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b/recovered.edits/4.seqid to hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/archive/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b/recovered.edits/4.seqid 2024-04-15 05:54:02,789 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524/recovered.edits/4.seqid to hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/archive/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524/recovered.edits/4.seqid 2024-04-15 05:54:02,790 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/a0fe88d0babce7cb5f5022b81de0845b 2024-04-15 05:54:02,790 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/.tmp/data/TestNs/TestTable/e1b03d89859b04f3ed2f6416b6f59524 2024-04-15 05:54:02,790 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-04-15 05:54:02,793 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-15 05:54:02,795 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-04-15 05:54:02,797 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-04-15 05:54:02,799 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-15 05:54:02,799 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-04-15 05:54:02,799 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713160442799"}]},"ts":"9223372036854775807"} 2024-04-15 05:54:02,799 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713160442799"}]},"ts":"9223372036854775807"} 2024-04-15 05:54:02,801 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-04-15 05:54:02,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a0fe88d0babce7cb5f5022b81de0845b, NAME => 'TestNs:TestTable,,1713160380050.a0fe88d0babce7cb5f5022b81de0845b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e1b03d89859b04f3ed2f6416b6f59524, NAME => 'TestNs:TestTable,1,1713160380050.e1b03d89859b04f3ed2f6416b6f59524.', STARTKEY => '1', ENDKEY => ''}] 2024-04-15 05:54:02,801 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-04-15 05:54:02,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713160442801"}]},"ts":"9223372036854775807"} 2024-04-15 05:54:02,803 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-04-15 05:54:02,805 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-15 05:54:02,806 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 39 msec 2024-04-15 05:54:03,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-04-15 05:54:03,026 INFO [Listener at localhost/41827] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-04-15 05:54:03,035 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$17(3092): Client=jenkins//148.251.75.209 delete TestNs 2024-04-15 05:54:03,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-04-15 05:54:03,044 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-15 05:54:03,048 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-15 05:54:03,051 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-15 05:54:03,052 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-04-15 05:54:03,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-04-15 05:54:03,052 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-15 05:54:03,053 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-15 05:54:03,056 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-15 05:54:03,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 21 msec 2024-04-15 05:54:03,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-04-15 05:54:03,306 INFO [Listener at localhost/41827] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-04-15 05:54:03,307 INFO [Listener at localhost/41827] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-04-15 05:54:03,308 DEBUG [Listener at localhost/41827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x163b61ec to 127.0.0.1:62954 2024-04-15 05:54:03,308 DEBUG [Listener at localhost/41827] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:54:03,311 DEBUG [Listener at localhost/41827] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-04-15 05:54:03,311 DEBUG [Listener at localhost/41827] util.JVMClusterUtil(257): Found active master hash=631132484, stopped=false 2024-04-15 05:54:03,311 DEBUG [Listener at localhost/41827] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-04-15 05:54:03,312 INFO [Listener at localhost/41827] master.ServerManager(904): Cluster shutdown requested of master=jenkins-hbase20.apache.org,33599,1713160372399 2024-04-15 05:54:03,314 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-04-15 05:54:03,314 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-04-15 05:54:03,314 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-04-15 05:54:03,314 INFO [Listener at localhost/41827] procedure2.ProcedureExecutor(675): Stopping 2024-04-15 05:54:03,314 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-15 05:54:03,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-15 05:54:03,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-15 05:54:03,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-15 05:54:03,315 DEBUG [Listener at localhost/41827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x288b7a79 to 127.0.0.1:62954 2024-04-15 05:54:03,315 DEBUG [Listener at localhost/41827] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:54:03,315 INFO [Listener at localhost/41827] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase20.apache.org,38727,1713160373549' ***** 2024-04-15 05:54:03,316 INFO [Listener at localhost/41827] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-04-15 05:54:03,316 INFO [Listener at localhost/41827] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase20.apache.org,41783,1713160373618' ***** 2024-04-15 05:54:03,316 INFO [Listener at localhost/41827] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-04-15 05:54:03,316 INFO [RS:0;jenkins-hbase20:38727] regionserver.HeapMemoryManager(220): Stopping 2024-04-15 05:54:03,316 INFO [RS:0;jenkins-hbase20:38727] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-04-15 05:54:03,316 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-04-15 05:54:03,316 INFO [RS:0;jenkins-hbase20:38727] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-04-15 05:54:03,316 INFO [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(3307): Received CLOSE for 802641f33321ff154f831a48f5f2c6a1 2024-04-15 05:54:03,317 INFO [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(1147): stopping server jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:54:03,317 INFO [RS:0;jenkins-hbase20:38727] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-04-15 05:54:03,317 INFO [RS:1;jenkins-hbase20:41783] regionserver.HeapMemoryManager(220): Stopping 2024-04-15 05:54:03,317 DEBUG [RS:0;jenkins-hbase20:38727] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34a39370 to 127.0.0.1:62954 2024-04-15 05:54:03,317 INFO [RS:1;jenkins-hbase20:41783] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-04-15 05:54:03,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 802641f33321ff154f831a48f5f2c6a1, disabling compactions & flushes 2024-04-15 05:54:03,317 INFO [RS:1;jenkins-hbase20:41783] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-04-15 05:54:03,317 DEBUG [RS:0;jenkins-hbase20:38727] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:54:03,317 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-04-15 05:54:03,317 INFO [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2024-04-15 05:54:03,317 INFO [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(3307): Received CLOSE for 368c68480e6a0e6c4e2df632067be36b 2024-04-15 05:54:03,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. 2024-04-15 05:54:03,318 INFO [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(1147): stopping server jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:54:03,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 368c68480e6a0e6c4e2df632067be36b, disabling compactions & flushes 2024-04-15 05:54:03,317 DEBUG [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(1481): Online Regions={802641f33321ff154f831a48f5f2c6a1=hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1.} 2024-04-15 05:54:03,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. 2024-04-15 05:54:03,318 INFO [RS:1;jenkins-hbase20:41783] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-04-15 05:54:03,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. 2024-04-15 05:54:03,318 DEBUG [RS:1;jenkins-hbase20:41783] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66b696ee to 127.0.0.1:62954 2024-04-15 05:54:03,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. after waiting 0 ms 2024-04-15 05:54:03,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. 2024-04-15 05:54:03,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. 2024-04-15 05:54:03,318 DEBUG [RS:1;jenkins-hbase20:41783] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:54:03,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 802641f33321ff154f831a48f5f2c6a1 1/1 column families, dataSize=147 B heapSize=704 B 2024-04-15 05:54:03,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. after waiting 0 ms 2024-04-15 05:54:03,319 INFO [RS:1;jenkins-hbase20:41783] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-04-15 05:54:03,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. 2024-04-15 05:54:03,319 INFO [RS:1;jenkins-hbase20:41783] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-04-15 05:54:03,319 INFO [RS:1;jenkins-hbase20:41783] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-04-15 05:54:03,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 368c68480e6a0e6c4e2df632067be36b 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-04-15 05:54:03,319 INFO [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(3307): Received CLOSE for 1588230740 2024-04-15 05:54:03,320 INFO [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2024-04-15 05:54:03,320 DEBUG [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(1481): Online Regions={368c68480e6a0e6c4e2df632067be36b=hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b., 1588230740=hbase:meta,,1.1588230740} 2024-04-15 05:54:03,320 DEBUG [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(1507): Waiting on 1588230740, 368c68480e6a0e6c4e2df632067be36b 2024-04-15 05:54:03,320 DEBUG [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(1507): Waiting on 802641f33321ff154f831a48f5f2c6a1 2024-04-15 05:54:03,321 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-04-15 05:54:03,321 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-04-15 05:54:03,321 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-04-15 05:54:03,321 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-04-15 05:54:03,321 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-04-15 05:54:03,322 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.17 KB heapSize=25.12 KB 2024-04-15 05:54:03,328 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-04-15 05:54:03,328 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-04-15 05:54:03,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/.tmp/q/2cee974666974d0f90124be0b77f7dea 2024-04-15 05:54:03,363 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.18 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/.tmp/info/db879557459a45e9a76d850eaf0e771d 2024-04-15 05:54:03,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1/.tmp/info/0fa89aa7f31d4aa0a834aa5c8efa04bc 2024-04-15 05:54:03,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cee974666974d0f90124be0b77f7dea 2024-04-15 05:54:03,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0fa89aa7f31d4aa0a834aa5c8efa04bc 2024-04-15 05:54:03,374 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db879557459a45e9a76d850eaf0e771d 2024-04-15 05:54:03,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1/.tmp/info/0fa89aa7f31d4aa0a834aa5c8efa04bc as hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1/info/0fa89aa7f31d4aa0a834aa5c8efa04bc 2024-04-15 05:54:03,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0fa89aa7f31d4aa0a834aa5c8efa04bc 2024-04-15 05:54:03,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1/info/0fa89aa7f31d4aa0a834aa5c8efa04bc, entries=3, sequenceid=8, filesize=5.0 K 2024-04-15 05:54:03,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 802641f33321ff154f831a48f5f2c6a1 in 71ms, sequenceid=8, compaction requested=false 2024-04-15 05:54:03,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/.tmp/u/3c981e5c995a4ae8afdb57702dd085ee 2024-04-15 05:54:03,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/.tmp/rep_barrier/7aecf38935b6406ab2807af9aea02ff3 2024-04-15 05:54:03,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/namespace/802641f33321ff154f831a48f5f2c6a1/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-04-15 05:54:03,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. 2024-04-15 05:54:03,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 802641f33321ff154f831a48f5f2c6a1: 2024-04-15 05:54:03,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1713160375964.802641f33321ff154f831a48f5f2c6a1. 2024-04-15 05:54:03,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c981e5c995a4ae8afdb57702dd085ee 2024-04-15 05:54:03,404 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7aecf38935b6406ab2807af9aea02ff3 2024-04-15 05:54:03,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/.tmp/q/2cee974666974d0f90124be0b77f7dea as hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/q/2cee974666974d0f90124be0b77f7dea 2024-04-15 05:54:03,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cee974666974d0f90124be0b77f7dea 2024-04-15 05:54:03,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/q/2cee974666974d0f90124be0b77f7dea, entries=5, sequenceid=17, filesize=5.1 K 2024-04-15 05:54:03,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/.tmp/u/3c981e5c995a4ae8afdb57702dd085ee as hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/u/3c981e5c995a4ae8afdb57702dd085ee 2024-04-15 05:54:03,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/.tmp/table/15693577022d4acaad1a120e639da48b 2024-04-15 05:54:03,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c981e5c995a4ae8afdb57702dd085ee 2024-04-15 05:54:03,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/u/3c981e5c995a4ae8afdb57702dd085ee, entries=4, sequenceid=17, filesize=5.0 K 2024-04-15 05:54:03,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15693577022d4acaad1a120e639da48b 2024-04-15 05:54:03,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 368c68480e6a0e6c4e2df632067be36b in 111ms, sequenceid=17, compaction requested=false 2024-04-15 05:54:03,433 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/.tmp/info/db879557459a45e9a76d850eaf0e771d as hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/info/db879557459a45e9a76d850eaf0e771d 2024-04-15 05:54:03,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/quota/368c68480e6a0e6c4e2df632067be36b/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-04-15 05:54:03,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. 2024-04-15 05:54:03,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 368c68480e6a0e6c4e2df632067be36b: 2024-04-15 05:54:03,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1713160376793.368c68480e6a0e6c4e2df632067be36b. 2024-04-15 05:54:03,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db879557459a45e9a76d850eaf0e771d 2024-04-15 05:54:03,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/info/db879557459a45e9a76d850eaf0e771d, entries=30, sequenceid=66, filesize=8.0 K 2024-04-15 05:54:03,444 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/.tmp/rep_barrier/7aecf38935b6406ab2807af9aea02ff3 as hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/rep_barrier/7aecf38935b6406ab2807af9aea02ff3 2024-04-15 05:54:03,452 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7aecf38935b6406ab2807af9aea02ff3 2024-04-15 05:54:03,453 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/rep_barrier/7aecf38935b6406ab2807af9aea02ff3, entries=5, sequenceid=66, filesize=5.3 K 2024-04-15 05:54:03,454 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/.tmp/table/15693577022d4acaad1a120e639da48b as hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/table/15693577022d4acaad1a120e639da48b 2024-04-15 05:54:03,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15693577022d4acaad1a120e639da48b 2024-04-15 05:54:03,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/table/15693577022d4acaad1a120e639da48b, entries=13, sequenceid=66, filesize=5.6 K 2024-04-15 05:54:03,463 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.17 KB/14513, heapSize ~25.07 KB/25672, currentSize=0 B/0 for 1588230740 in 142ms, sequenceid=66, compaction requested=false 2024-04-15 05:54:03,472 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-04-15 05:54:03,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-04-15 05:54:03,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-04-15 05:54:03,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-04-15 05:54:03,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-04-15 05:54:03,520 INFO [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(1173): stopping server jenkins-hbase20.apache.org,41783,1713160373618; all regions closed. 2024-04-15 05:54:03,521 INFO [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(1173): stopping server jenkins-hbase20.apache.org,38727,1713160373549; all regions closed. 2024-04-15 05:54:03,521 DEBUG [RS:0;jenkins-hbase20:38727] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-04-15 05:54:03,521 DEBUG [RS:1;jenkins-hbase20:41783] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-04-15 05:54:03,534 DEBUG [RS:0;jenkins-hbase20:38727] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/oldWALs 2024-04-15 05:54:03,534 INFO [RS:0;jenkins-hbase20:38727] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38727%2C1713160373549:(num 1713160375337) 2024-04-15 05:54:03,534 DEBUG [RS:1;jenkins-hbase20:41783] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/oldWALs 2024-04-15 05:54:03,534 DEBUG [RS:0;jenkins-hbase20:38727] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:54:03,534 INFO [RS:1;jenkins-hbase20:41783] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41783%2C1713160373618.meta:.meta(num 1713160375592) 2024-04-15 05:54:03,534 INFO [RS:0;jenkins-hbase20:38727] regionserver.LeaseManager(133): Closed leases 2024-04-15 05:54:03,535 INFO [RS:0;jenkins-hbase20:38727] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-04-15 05:54:03,535 INFO [RS:0;jenkins-hbase20:38727] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-04-15 05:54:03,535 INFO [RS:0;jenkins-hbase20:38727] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-04-15 05:54:03,535 INFO [RS:0;jenkins-hbase20:38727] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-04-15 05:54:03,535 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-04-15 05:54:03,536 INFO [RS:0;jenkins-hbase20:38727] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38727 2024-04-15 05:54:03,542 DEBUG [RS:1;jenkins-hbase20:41783] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/oldWALs 2024-04-15 05:54:03,542 INFO [RS:1;jenkins-hbase20:41783] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41783%2C1713160373618:(num 1713160375333) 2024-04-15 05:54:03,542 DEBUG [RS:1;jenkins-hbase20:41783] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:54:03,542 INFO [RS:1;jenkins-hbase20:41783] regionserver.LeaseManager(133): Closed leases 2024-04-15 05:54:03,542 INFO [RS:1;jenkins-hbase20:41783] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-04-15 05:54:03,543 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-04-15 05:54:03,543 INFO [RS:1;jenkins-hbase20:41783] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41783 2024-04-15 05:54:03,546 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:54:03,546 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-15 05:54:03,546 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41783,1713160373618 2024-04-15 05:54:03,546 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-15 05:54:03,546 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:54:03,546 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-15 05:54:03,546 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38727,1713160373549 2024-04-15 05:54:03,547 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38727,1713160373549] 2024-04-15 05:54:03,547 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38727,1713160373549; numProcessing=1 2024-04-15 05:54:03,548 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,38727,1713160373549 already deleted, retry=false 2024-04-15 05:54:03,548 INFO [RegionServerTracker-0] master.ServerManager(570): Cluster shutdown set; jenkins-hbase20.apache.org,38727,1713160373549 expired; onlineServers=1 2024-04-15 05:54:03,548 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,41783,1713160373618] 2024-04-15 05:54:03,548 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41783,1713160373618; numProcessing=2 2024-04-15 05:54:03,548 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,41783,1713160373618 already deleted, retry=false 2024-04-15 05:54:03,549 INFO [RegionServerTracker-0] master.ServerManager(570): Cluster shutdown set; jenkins-hbase20.apache.org,41783,1713160373618 expired; onlineServers=0 2024-04-15 05:54:03,549 INFO [RegionServerTracker-0] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase20.apache.org,33599,1713160372399' ***** 2024-04-15 05:54:03,549 INFO [RegionServerTracker-0] regionserver.HRegionServer(2313): STOPPED: Cluster shutdown set; onlineServer=0 2024-04-15 05:54:03,549 DEBUG [M:0;jenkins-hbase20:33599] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24e1ee6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2024-04-15 05:54:03,550 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegionServer(1147): stopping server jenkins-hbase20.apache.org,33599,1713160372399 2024-04-15 05:54:03,550 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegionServer(1173): stopping server jenkins-hbase20.apache.org,33599,1713160372399; all regions closed. 2024-04-15 05:54:03,550 DEBUG [M:0;jenkins-hbase20:33599] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-15 05:54:03,550 DEBUG [M:0;jenkins-hbase20:33599] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-04-15 05:54:03,550 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-04-15 05:54:03,550 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1713160374891] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1713160374891,5,FailOnTimeoutGroup] 2024-04-15 05:54:03,550 DEBUG [M:0;jenkins-hbase20:33599] cleaner.HFileCleaner(317): Stopping file delete threads 2024-04-15 05:54:03,550 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1713160374892] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1713160374892,5,FailOnTimeoutGroup] 2024-04-15 05:54:03,550 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-04-15 05:54:03,551 INFO [M:0;jenkins-hbase20:33599] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-04-15 05:54:03,551 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-15 05:54:03,551 INFO [M:0;jenkins-hbase20:33599] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-04-15 05:54:03,551 INFO [M:0;jenkins-hbase20:33599] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-04-15 05:54:03,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-15 05:54:03,551 DEBUG [M:0;jenkins-hbase20:33599] master.HMaster(1517): Stopping service threads 2024-04-15 05:54:03,551 INFO [M:0;jenkins-hbase20:33599] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-04-15 05:54:03,552 ERROR [M:0;jenkins-hbase20:33599] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-04-15 05:54:03,552 INFO [M:0;jenkins-hbase20:33599] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-04-15 05:54:03,552 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-04-15 05:54:03,553 DEBUG [M:0;jenkins-hbase20:33599] zookeeper.ZKUtil(399): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-04-15 05:54:03,553 WARN [M:0;jenkins-hbase20:33599] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-04-15 05:54:03,553 INFO [M:0;jenkins-hbase20:33599] assignment.AssignmentManager(315): Stopping assignment manager 2024-04-15 05:54:03,553 INFO [M:0;jenkins-hbase20:33599] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-04-15 05:54:03,554 DEBUG [M:0;jenkins-hbase20:33599] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-04-15 05:54:03,554 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-15 05:54:03,554 DEBUG [M:0;jenkins-hbase20:33599] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-15 05:54:03,554 DEBUG [M:0;jenkins-hbase20:33599] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-04-15 05:54:03,554 DEBUG [M:0;jenkins-hbase20:33599] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-15 05:54:03,554 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=153.10 KB heapSize=184.90 KB 2024-04-15 05:54:03,572 INFO [M:0;jenkins-hbase20:33599] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=153.10 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f2518fd700144ae7986a73ff2e7279c7 2024-04-15 05:54:03,579 INFO [M:0;jenkins-hbase20:33599] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2518fd700144ae7986a73ff2e7279c7 2024-04-15 05:54:03,581 DEBUG [M:0;jenkins-hbase20:33599] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f2518fd700144ae7986a73ff2e7279c7 as hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f2518fd700144ae7986a73ff2e7279c7 2024-04-15 05:54:03,588 INFO [M:0;jenkins-hbase20:33599] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2518fd700144ae7986a73ff2e7279c7 2024-04-15 05:54:03,588 INFO [M:0;jenkins-hbase20:33599] regionserver.HStore(1080): Added hdfs://localhost:40455/user/jenkins/test-data/cc470a08-c5a9-62f7-be2e-537f164c06d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f2518fd700144ae7986a73ff2e7279c7, entries=45, sequenceid=376, filesize=12.0 K 2024-04-15 05:54:03,589 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegion(2948): Finished flush of dataSize ~153.10 KB/156774, heapSize ~184.88 KB/189320, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 35ms, sequenceid=376, compaction requested=false 2024-04-15 05:54:03,591 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-15 05:54:03,591 DEBUG [M:0;jenkins-hbase20:33599] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-04-15 05:54:03,597 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-04-15 05:54:03,597 INFO [M:0;jenkins-hbase20:33599] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-04-15 05:54:03,597 INFO [M:0;jenkins-hbase20:33599] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:33599 2024-04-15 05:54:03,599 DEBUG [M:0;jenkins-hbase20:33599] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,33599,1713160372399 already deleted, retry=false 2024-04-15 05:54:03,648 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-15 05:54:03,648 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-15 05:54:03,648 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x10105aefe180001, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-15 05:54:03,648 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): regionserver:41783-0x10105aefe180002, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-15 05:54:03,648 INFO [RS:1;jenkins-hbase20:41783] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase20.apache.org,41783,1713160373618; zookeeper connection closed. 2024-04-15 05:54:03,648 INFO [RS:0;jenkins-hbase20:38727] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase20.apache.org,38727,1713160373549; zookeeper connection closed. 2024-04-15 05:54:03,649 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5af28033] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5af28033 2024-04-15 05:54:03,649 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@93eeb95] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@93eeb95 2024-04-15 05:54:03,650 INFO [Listener at localhost/41827] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-04-15 05:54:03,701 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-15 05:54:03,701 DEBUG [Listener at localhost/41827-EventThread] zookeeper.ZKWatcher(600): master:33599-0x10105aefe180000, quorum=127.0.0.1:62954, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-15 05:54:03,701 INFO [M:0;jenkins-hbase20:33599] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase20.apache.org,33599,1713160372399; zookeeper connection closed. 2024-04-15 05:54:03,706 WARN [Listener at localhost/41827] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-04-15 05:54:03,712 INFO [Listener at localhost/41827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-04-15 05:54:03,820 WARN [BP-1548134095-148.251.75.209-1713160369090 heartbeating to localhost/127.0.0.1:40455] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-04-15 05:54:03,820 WARN [BP-1548134095-148.251.75.209-1713160369090 heartbeating to localhost/127.0.0.1:40455] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1548134095-148.251.75.209-1713160369090 (Datanode Uuid 9e0f8a13-091f-425b-b3ed-85e5d51edbba) service to localhost/127.0.0.1:40455 2024-04-15 05:54:03,822 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/cluster_fd9b8b7d-3cdf-2ce6-b5b3-d89354f8bc33/dfs/data/data3/current/BP-1548134095-148.251.75.209-1713160369090] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-15 05:54:03,823 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/cluster_fd9b8b7d-3cdf-2ce6-b5b3-d89354f8bc33/dfs/data/data4/current/BP-1548134095-148.251.75.209-1713160369090] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-15 05:54:03,824 WARN [Listener at localhost/41827] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-04-15 05:54:03,826 INFO [Listener at localhost/41827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-04-15 05:54:03,936 WARN [BP-1548134095-148.251.75.209-1713160369090 heartbeating to localhost/127.0.0.1:40455] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-04-15 05:54:03,936 WARN [BP-1548134095-148.251.75.209-1713160369090 heartbeating to localhost/127.0.0.1:40455] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1548134095-148.251.75.209-1713160369090 (Datanode Uuid 89afc542-4c7f-4c71-852b-ba77057224dd) service to localhost/127.0.0.1:40455 2024-04-15 05:54:03,937 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/cluster_fd9b8b7d-3cdf-2ce6-b5b3-d89354f8bc33/dfs/data/data1/current/BP-1548134095-148.251.75.209-1713160369090] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-15 05:54:03,938 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b42c0ae4-e978-bb5e-de78-7eeaf8a90043/cluster_fd9b8b7d-3cdf-2ce6-b5b3-d89354f8bc33/dfs/data/data2/current/BP-1548134095-148.251.75.209-1713160369090] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-15 05:54:03,970 INFO [Listener at localhost/41827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-04-15 05:54:04,093 INFO [Listener at localhost/41827] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-04-15 05:54:04,134 INFO [Listener at localhost/41827] hbase.HBaseTestingUtility(1293): Minicluster is down